Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29266 originally caused by: Started by upstream project "master-osmo-msc" build number 34212 originally caused by: Started by upstream project "master-osmo-mgw" build number 9178 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12970 originally caused by: Started by upstream project "master-openbsc" build number 13166 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9111 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17657 originally caused by: Started by upstream project "master-osmo-bsc" build number 20112 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9111 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30044 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37197 originally caused by: Started by upstream project "master-osmo-iuh" build number 12851 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9111 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29267 originally caused by: Started by upstream project "master-osmo-msc" build number 34213 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9111 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34214 originally caused by: Started by upstream project "master-osmo-iuh" build number 12851 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9111 Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17657 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8946 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2952 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29267 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30044 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12970 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9241 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins13886188516460183693.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 03:34:28 + trial_dir_prefix=trial- + rm -rf trial-2368 trial-2368-bin.tgz trial-2368-run.tgz + trial_dir=trial-2369 + mkdir -p trial-2369 + mv open5gs.build-8.tgz osmo-bsc.build-17657.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2952.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29267.tgz osmo-nitb.build-12970.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30044.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2369 + cat open5gs.build-8.md5 osmo-bsc.build-17657.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2952.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29267.md5 osmo-nitb.build-12970.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30044.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17657.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2952.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29267.md5 osmo-nitb.build-12970.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30044.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2369 combinations: None trial: 'trial-2369' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2369 -------------------------------------------------------------------------------------------- 03:34:39.684282 tst trial-2369: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/log --------------------------------------------------------------------- trial-2369 nitb_sms:sysmo --------------------------------------------------------------------- 03:36:45.913450 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:36:45.916853 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 03:36:45.940450 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 03:36:45.948291 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 03:36:46.015598 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 03:36:46.059174 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 03:36:46.066940 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 03:36:46.590523 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 03:36:46.597556 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 03:36:46.612480 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 03:36:47.050166 tst mo_mt_sms.py: using LAC 25713 03:36:47.287532 tst mo_mt_sms.py: using RAC 213 03:36:47.403622 tst mo_mt_sms.py: using CellId 25713 03:36:47.512676 tst mo_mt_sms.py: using BVCI 25714 03:36:47.613692 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 03:36:47.790395 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 03:36:47.904710 tst mo_mt_sms.py:9: start nitb and bts... 03:36:48.110859 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:36:50.410225 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21122): Launched 03:36:50.715771 run osmo-nitb_10.42.42.2(pid=21123): Launched 03:36:50.882157 run osmo-nitb_10.42.42.2(pid=21123): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21123)] 03:36:51.007948 run osmo-nitb_10.42.42.2(pid=21123): stdout: | (launched: 2022-12-10_03:36:50.660020) 03:36:51.135454 run osmo-nitb_10.42.42.2(pid=21123): stderr: | (launched: 2022-12-10_03:36:50.705806) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:36:51.263071 run osmo-nitb_10.42.42.2(pid=21123): stdout: | (launched: 2022-12-10_03:36:50.660020) 03:36:51.384878 run osmo-nitb_10.42.42.2(pid=21123): stderr: | (launched: 2022-12-10_03:36:50.705806) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:36:51.531154 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21123): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21123) [trial-2369↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21123)] [trial-2369↪nitb_sms:sysmo↪mo_mt_sms.py:11] 03:36:51.539976 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 03:36:51.546892 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21122): Terminating (SIGTERM) 03:36:51.756505 --- ParallelTerminationStrategy: PID 21122 died... 03:36:51.777455 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21122): Terminated: ok {rc=0} 03:36:51.864336 bus /sierra_3: Setting Powered False 03:36:52.960937 bus /sierra_3: Setting Powered False 03:36:54.076441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:sysmo --------------------------------------------------------------------- 03:36:55.253965 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:36:55.257818 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 03:36:55.278063 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 03:36:55.305444 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 03:36:55.360248 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 03:36:55.381749 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 03:36:55.409122 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 03:36:55.954898 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:sysmo mo_mt_sms.py ---------------------------------------------- 03:36:55.960150 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:36:55.971047 tst sms:sysmo: Using 1 x bts (candidates: 1) 03:36:56.006261 tst mo_mt_sms.py: using LAC 25714 03:36:56.128897 tst mo_mt_sms.py: using RAC 214 03:36:56.248455 tst mo_mt_sms.py: using CellId 25714 03:36:56.367993 tst mo_mt_sms.py: using BVCI 25715 03:36:56.472917 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:36:56.483334 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:36:56.493699 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:36:56.504224 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:36:56.514747 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:36:56.525235 tst sms:sysmo: Using 1 x modem (candidates: 2) 03:36:56.638752 tst sms:sysmo: Using 1 x modem (candidates: 2) 03:36:56.754227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:36:58.421649 run create_hlr_db(pid=21129): Launched 03:36:58.530150 bus /sierra_2: Setting Powered False 03:36:59.588231 run create_hlr_db(pid=21129): Terminated: ok {rc=0} 03:37:00.010490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21131): Launched 03:37:00.317624 run osmo-hlr_10.42.42.2(pid=21132): Launched 03:37:00.435382 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:02.985153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21134): Launched 03:37:03.291615 run osmo-stp_10.42.42.5(pid=21135): Launched 03:37:03.408384 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:08.755692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21137): Launched 03:37:09.061294 run osmo-msc_10.42.42.6(pid=21138): Launched 03:37:09.231149 run osmo-stp_10.42.42.5(pid=21135): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21135)] 03:37:09.359800 run osmo-stp_10.42.42.5(pid=21135): stdout: | (launched: 2022-12-10_03:37:03.235303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:09.488773 run osmo-stp_10.42.42.5(pid=21135): stderr: | 20221210033703426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033703426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033703426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033703427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033703427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033703427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033703427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:09.618075 run osmo-stp_10.42.42.5(pid=21135): stdout: | (launched: 2022-12-10_03:37:03.235303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:09.743670 run osmo-stp_10.42.42.5(pid=21135): stderr: | 20221210033703426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033703426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033703426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033703427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033703427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033703427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033703427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:09.889847 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21135): Process ended prematurely: osmo-stp_10.42.42.5(pid=21135) [trial-2369↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21135)] [trial-2369↪sms:sysmo↪mo_mt_sms.py:16] 03:37:09.898735 tst mo_mt_sms.py:16: Test FAILED (13.9 sec) 03:37:09.925629 run osmo-hlr_10.42.42.2(pid=21132): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21132)] 03:37:09.975062 run osmo-hlr_10.42.42.2(pid=21132): stdout: | (launched: 2022-12-10_03:37:00.261947) 03:37:10.026158 run osmo-hlr_10.42.42.2(pid=21132): stderr: | 20221210033700456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033700456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033700456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033700456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033700456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033700457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033700470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033700478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033700478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033700478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:10.096925 run osmo-msc_10.42.42.6(pid=21138): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21138)] 03:37:10.146400 run osmo-msc_10.42.42.6(pid=21138): stdout: | (launched: 2022-12-10_03:37:09.005250) 03:37:10.197528 run osmo-msc_10.42.42.6(pid=21138): stderr: | 20221210033709328 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033709328 DLGLOBAL DEBUG validating counter group 0x7f05c0f7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033709328 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033709328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033709329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033709329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033709330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033709331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033709331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033709331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:10.249096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21131): Terminating (SIGTERM) 03:37:10.290217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21134): Terminating (SIGTERM) 03:37:10.331479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21137): Terminating (SIGTERM) 03:37:10.372867 --- ParallelTerminationStrategy: PID 21131 died... 03:37:10.392588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21131): Terminated: ok {rc=0} 03:37:10.438109 --- ParallelTerminationStrategy: PID 21134 died... 03:37:10.457419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21134): Terminated: ok {rc=0} 03:37:10.503719 --- ParallelTerminationStrategy: PID 21137 died... 03:37:10.522919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21137): Terminated: ok {rc=0} 03:37:10.609926 bus /sierra_3: Setting Powered False 03:37:11.708114 bus /sierra_3: Setting Powered False 03:37:12.825225 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:sysmo --------------------------------------------------------------------- 03:37:14.037162 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:14.040620 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 03:37:14.061631 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 03:37:14.068870 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 03:37:14.102804 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 03:37:14.123395 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 03:37:14.130630 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 03:37:14.651397 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 03:37:14.657244 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 03:37:14.668054 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 03:37:14.703635 tst assert_extension.py: using LAC 25715 03:37:14.826678 tst assert_extension.py: using RAC 215 03:37:14.947353 tst assert_extension.py: using CellId 25715 03:37:15.069522 tst assert_extension.py: using BVCI 25716 03:37:15.182192 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 03:37:15.292452 tst assert_extension.py:10: start nitb and bts... 03:37:15.485352 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:37:16.126471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21143): Launched 03:37:16.437371 run osmo-nitb_10.42.42.2(pid=21144): Launched 03:37:16.611223 run osmo-nitb_10.42.42.2(pid=21144): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21144)] 03:37:16.743806 run osmo-nitb_10.42.42.2(pid=21144): stdout: | (launched: 2022-12-10_03:37:16.367636) 03:37:16.878188 run osmo-nitb_10.42.42.2(pid=21144): stderr: | (launched: 2022-12-10_03:37:16.410840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:17.034903 run osmo-nitb_10.42.42.2(pid=21144): stdout: | (launched: 2022-12-10_03:37:16.367636) 03:37:17.163325 run osmo-nitb_10.42.42.2(pid=21144): stderr: | (launched: 2022-12-10_03:37:16.410840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21144) [trial-2369↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21144)] 03:37:17.558910 tst osmo-nitb_10.42.42.2(pid=21144): stdout: | (launched: 2022-12-10_03:37:16.367636) 03:37:17.676438 tst osmo-nitb_10.42.42.2(pid=21144): stderr: | (launched: 2022-12-10_03:37:16.410840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:17.813743 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21144) [trial-2369↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21144)] [trial-2369↪nitb_ussd:sysmo↪assert_extension.py:12] 03:37:17.822296 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:37:17.829158 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21143): Terminating (SIGTERM) 03:37:18.037987 --- ParallelTerminationStrategy: PID 21143 died... 03:37:18.058746 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21143): Terminated: ok {rc=0} 03:37:18.143438 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:sysmo --------------------------------------------------------------------- 03:37:19.308698 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:19.312728 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 03:37:19.334468 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 03:37:19.361762 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 03:37:19.398108 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 03:37:19.419712 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 03:37:19.448585 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 03:37:19.987997 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:sysmo assert_extension.py ---------------------------------------------- 03:37:19.993956 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:20.009290 tst ussd:sysmo: Using 1 x bts (candidates: 1) 03:37:20.047201 tst assert_extension.py: using LAC 25716 03:37:20.168167 tst assert_extension.py: using RAC 216 03:37:20.287573 tst assert_extension.py: using CellId 25716 03:37:20.406640 tst assert_extension.py: using BVCI 25717 03:37:20.519497 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:20.530432 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:20.541260 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:20.552417 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:20.563664 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:20.574834 tst ussd:sysmo: Using 1 x modem (candidates: 1) 03:37:20.686975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:21.134794 run create_hlr_db(pid=21149): Launched 03:37:21.244645 bus /sierra_2: Setting Powered False 03:37:22.303369 run create_hlr_db(pid=21149): Terminated: ok {rc=0} 03:37:22.706669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21151): Launched 03:37:22.994681 run osmo-hlr_10.42.42.2(pid=21152): Launched 03:37:23.103991 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:23.602505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21154): Launched 03:37:23.890299 run osmo-stp_10.42.42.5(pid=21155): Launched 03:37:24.000064 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:24.519604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21157): Launched 03:37:24.807310 run osmo-msc_10.42.42.6(pid=21158): Launched 03:37:24.967994 run osmo-stp_10.42.42.5(pid=21155): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21155)] 03:37:25.102969 run osmo-stp_10.42.42.5(pid=21155): stdout: | (launched: 2022-12-10_03:37:23.836918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:25.226222 run osmo-stp_10.42.42.5(pid=21155): stderr: | 20221210033724005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033724005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033724006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033724006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033724006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033724007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033724007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:25.347251 run osmo-stp_10.42.42.5(pid=21155): stdout: | (launched: 2022-12-10_03:37:23.836918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:25.462782 run osmo-stp_10.42.42.5(pid=21155): stderr: | 20221210033724005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033724005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033724006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033724006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033724006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033724007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033724007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:25.600488 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21155): Process ended prematurely: osmo-stp_10.42.42.5(pid=21155) [trial-2369↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21155)] [trial-2369↪ussd:sysmo↪assert_extension.py:17] 03:37:25.608809 tst assert_extension.py:17: Test FAILED (5.6 sec) 03:37:25.634886 run osmo-hlr_10.42.42.2(pid=21152): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21152)] 03:37:25.682342 run osmo-hlr_10.42.42.2(pid=21152): stdout: | (launched: 2022-12-10_03:37:22.941760) 03:37:25.731468 run osmo-hlr_10.42.42.2(pid=21152): stderr: | 20221210033723115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033723115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033723115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033723115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033723115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033723115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033723129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033723137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033723137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033723137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:25.800233 run osmo-msc_10.42.42.6(pid=21158): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21158)] 03:37:25.847873 run osmo-msc_10.42.42.6(pid=21158): stdout: | (launched: 2022-12-10_03:37:24.754511) 03:37:25.897022 run osmo-msc_10.42.42.6(pid=21158): stderr: | 20221210033725025 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033725026 DLGLOBAL DEBUG validating counter group 0x7f167c135c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033725026 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033725026 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033725026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033725026 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033725028 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033725028 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033725029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033725029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:25.946533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21151): Terminating (SIGTERM) 03:37:25.986026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21154): Terminating (SIGTERM) 03:37:26.025556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21157): Terminating (SIGTERM) 03:37:26.065248 --- ParallelTerminationStrategy: PID 21151 died... 03:37:26.084051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21151): Terminated: ok {rc=0} 03:37:26.127893 --- ParallelTerminationStrategy: PID 21154 died... 03:37:26.146171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21154): Terminated: ok {rc=0} 03:37:26.189953 --- ParallelTerminationStrategy: PID 21157 died... 03:37:26.208286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21157): Terminated: ok {rc=0} 03:37:26.293041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:37:27.488903 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:27.496506 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:37:27.517860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:37:27.545333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:37:27.599272 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:37:27.620645 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:37:27.647653 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:37:28.198650 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:37:28.249925 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:28.261334 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:37:28.318158 tst mo_mt_call.py: using LAC 25717 03:37:28.443798 tst mo_mt_call.py: using RAC 217 03:37:28.565256 tst mo_mt_call.py: using CellId 25717 03:37:28.686752 tst mo_mt_call.py: using BVCI 25718 03:37:28.799717 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:28.811229 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:28.822874 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:28.834173 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:28.845534 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:28.856803 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:28.969221 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:29.085200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:29.539887 run create_hlr_db(pid=21164): Launched 03:37:29.653427 bus /sierra_2: Setting Powered False 03:37:30.716364 run create_hlr_db(pid=21164): Terminated: ok {rc=0} 03:37:31.183301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21166): Launched 03:37:31.511001 run osmo-hlr_10.42.42.2(pid=21167): Launched 03:37:31.754072 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:32.440362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21169): Launched 03:37:32.752745 run osmo-stp_10.42.42.5(pid=21170): Launched 03:37:32.871408 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:33.435967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21172): Launched 03:37:33.748181 run osmo-msc_10.42.42.6(pid=21173): Launched 03:37:33.921454 run osmo-stp_10.42.42.5(pid=21170): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21170)] 03:37:34.052930 run osmo-stp_10.42.42.5(pid=21170): stdout: | (launched: 2022-12-10_03:37:32.695792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:34.184878 run osmo-stp_10.42.42.5(pid=21170): stderr: | 20221210033732887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033732887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033732887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033732888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033732890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033732890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033732890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:34.316510 run osmo-stp_10.42.42.5(pid=21170): stdout: | (launched: 2022-12-10_03:37:32.695792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:34.441697 run osmo-stp_10.42.42.5(pid=21170): stderr: | 20221210033732887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033732887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033732887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033732888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033732890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033732890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033732890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:34.590946 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21170): Process ended prematurely: osmo-stp_10.42.42.5(pid=21170) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21170)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:37:34.600228 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:37:34.627456 run osmo-hlr_10.42.42.2(pid=21167): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21167)] 03:37:34.676350 run osmo-hlr_10.42.42.2(pid=21167): stdout: | (launched: 2022-12-10_03:37:31.449657) 03:37:34.727184 run osmo-hlr_10.42.42.2(pid=21167): stderr: | 20221210033731762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033731762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033731762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033731762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033731762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033731762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033731775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033731788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033731788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033731788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:34.797654 run osmo-msc_10.42.42.6(pid=21173): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21173)] 03:37:34.846384 run osmo-msc_10.42.42.6(pid=21173): stdout: | (launched: 2022-12-10_03:37:33.691220) 03:37:34.896777 run osmo-msc_10.42.42.6(pid=21173): stderr: | 20221210033734011 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033734011 DLGLOBAL DEBUG validating counter group 0x7f4e57c55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033734011 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033734011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033734012 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033734012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033734013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033734014 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033734014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033734014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:34.947672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21166): Terminating (SIGTERM) 03:37:34.988471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21169): Terminating (SIGTERM) 03:37:35.029352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21172): Terminating (SIGTERM) 03:37:35.070394 --- ParallelTerminationStrategy: PID 21166 died... 03:37:35.089860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21166): Terminated: ok {rc=0} 03:37:35.134937 --- ParallelTerminationStrategy: PID 21169 died... 03:37:35.153973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21169): Terminated: ok {rc=0} 03:37:35.199256 --- ParallelTerminationStrategy: PID 21172 died... 03:37:35.218441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21172): Terminated: ok {rc=0} 03:37:35.307451 bus /sierra_3: Setting Powered False 03:37:36.417500 bus /sierra_3: Setting Powered False 03:37:37.533822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:37:38.681085 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:38.693315 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:37:38.751987 tst mo_mt_call_osmux.py: using LAC 25718 03:37:38.877018 tst mo_mt_call_osmux.py: using RAC 218 03:37:38.999876 tst mo_mt_call_osmux.py: using CellId 25718 03:37:39.122951 tst mo_mt_call_osmux.py: using BVCI 25719 03:37:39.230539 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:39.241524 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:39.252275 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:39.263298 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:39.274432 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:39.285465 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:39.399827 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:39.514619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:39.968842 run create_hlr_db(pid=21175): Launched 03:37:40.080646 bus /sierra_2: Setting Powered False 03:37:41.139713 run create_hlr_db(pid=21175): Terminated: ok {rc=0} 03:37:41.549303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21177): Launched 03:37:41.842836 run osmo-hlr_10.42.42.2(pid=21178): Launched 03:37:41.955155 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:42.475886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21180): Launched 03:37:42.769497 run osmo-stp_10.42.42.5(pid=21181): Launched 03:37:42.881618 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:43.411921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21183): Launched 03:37:43.704839 run osmo-msc_10.42.42.6(pid=21184): Launched 03:37:43.869083 run osmo-stp_10.42.42.5(pid=21181): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21181)] 03:37:43.993919 run osmo-stp_10.42.42.5(pid=21181): stdout: | (launched: 2022-12-10_03:37:42.715688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:44.118721 run osmo-stp_10.42.42.5(pid=21181): stderr: | 20221210033742885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033742885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033742885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033742886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033742886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033742886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033742886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:44.240732 run osmo-stp_10.42.42.5(pid=21181): stdout: | (launched: 2022-12-10_03:37:42.715688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:44.357298 run osmo-stp_10.42.42.5(pid=21181): stderr: | 20221210033742885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033742885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033742885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033742886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033742886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033742886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033742886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:44.497355 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21181): Process ended prematurely: osmo-stp_10.42.42.5(pid=21181) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21181)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:37:44.506221 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 03:37:44.532667 run osmo-hlr_10.42.42.2(pid=21178): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21178)] 03:37:44.579960 run osmo-hlr_10.42.42.2(pid=21178): stdout: | (launched: 2022-12-10_03:37:41.789140) 03:37:44.628920 run osmo-hlr_10.42.42.2(pid=21178): stderr: | 20221210033741964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033741964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033741964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033741964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033741964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033741964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033741988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033741997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033741998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033741998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:44.697213 run osmo-msc_10.42.42.6(pid=21184): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21184)] 03:37:44.744359 run osmo-msc_10.42.42.6(pid=21184): stdout: | (launched: 2022-12-10_03:37:43.651240) 03:37:44.793254 run osmo-msc_10.42.42.6(pid=21184): stderr: | 20221210033743918 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033743918 DLGLOBAL DEBUG validating counter group 0x7f1798b59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033743918 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033743918 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033743918 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033743919 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033743920 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033743921 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033743921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033743921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:44.842264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21177): Terminating (SIGTERM) 03:37:44.881107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21180): Terminating (SIGTERM) 03:37:44.920102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21183): Terminating (SIGTERM) 03:37:44.959353 --- ParallelTerminationStrategy: PID 21177 died... 03:37:44.978051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21177): Terminated: ok {rc=0} 03:37:45.021640 --- ParallelTerminationStrategy: PID 21180 died... 03:37:45.039875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21180): Terminated: ok {rc=0} 03:37:45.083710 --- ParallelTerminationStrategy: PID 21183 died... 03:37:45.102069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21183): Terminated: ok {rc=0} 03:37:45.185088 bus /sierra_3: Setting Powered False 03:37:46.278309 bus /sierra_3: Setting Powered False 03:37:47.389439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:37:48.629621 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:48.637220 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:37:48.659037 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:37:48.686333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:37:48.738233 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:37:48.759286 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:37:48.786336 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:37:49.342442 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:37:49.392864 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:37:49.404376 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:37:49.465437 tst mo_mt_call.py: using LAC 25719 03:37:49.586952 tst mo_mt_call.py: using RAC 219 03:37:49.708421 tst mo_mt_call.py: using CellId 25719 03:37:49.830011 tst mo_mt_call.py: using BVCI 25720 03:37:49.943668 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:37:49.955126 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:37:49.966415 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:37:49.977591 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:37:49.988851 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:37:50.000122 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:37:50.117477 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:37:50.234000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:50.720310 run create_hlr_db(pid=21189): Launched 03:37:50.848524 bus /sierra_2: Setting Powered False 03:37:51.907082 run create_hlr_db(pid=21189): Terminated: ok {rc=0} 03:37:52.343711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21191): Launched 03:37:52.658434 run osmo-hlr_10.42.42.2(pid=21192): Launched 03:37:52.778238 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:53.317504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21194): Launched 03:37:53.630033 run osmo-stp_10.42.42.5(pid=21195): Launched 03:37:53.750215 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:54.317767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21197): Launched 03:37:54.632376 run osmo-msc_10.42.42.6(pid=21198): Launched 03:37:54.807521 run osmo-stp_10.42.42.5(pid=21195): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21195)] 03:37:54.939508 run osmo-stp_10.42.42.5(pid=21195): stdout: | (launched: 2022-12-10_03:37:53.573139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:55.071863 run osmo-stp_10.42.42.5(pid=21195): stderr: | 20221210033753765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033753765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033753765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033753765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033753766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033753766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033753766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:55.203832 run osmo-stp_10.42.42.5(pid=21195): stdout: | (launched: 2022-12-10_03:37:53.573139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:55.328405 run osmo-stp_10.42.42.5(pid=21195): stderr: | 20221210033753765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033753765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033753765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033753765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033753766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033753766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033753766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:55.477700 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21195): Process ended prematurely: osmo-stp_10.42.42.5(pid=21195) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21195)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:37:55.487327 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:37:55.514743 run osmo-hlr_10.42.42.2(pid=21192): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21192)] 03:37:55.563761 run osmo-hlr_10.42.42.2(pid=21192): stdout: | (launched: 2022-12-10_03:37:52.601692) 03:37:55.614600 run osmo-hlr_10.42.42.2(pid=21192): stderr: | 20221210033752799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033752799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033752799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033752800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033752800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033752800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033752876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033752885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033752886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033752886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:55.684898 run osmo-msc_10.42.42.6(pid=21198): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21198)] 03:37:55.734294 run osmo-msc_10.42.42.6(pid=21198): stdout: | (launched: 2022-12-10_03:37:54.575057) 03:37:55.785230 run osmo-msc_10.42.42.6(pid=21198): stderr: | 20221210033754899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033754899 DLGLOBAL DEBUG validating counter group 0x7f0711298c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033754899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033754899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033754899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033754900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033754903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033754904 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033754904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033754904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:55.835956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21191): Terminating (SIGTERM) 03:37:55.876659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21194): Terminating (SIGTERM) 03:37:55.917519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21197): Terminating (SIGTERM) 03:37:55.958436 --- ParallelTerminationStrategy: PID 21191 died... 03:37:55.978008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21191): Terminated: ok {rc=0} 03:37:56.023497 --- ParallelTerminationStrategy: PID 21194 died... 03:37:56.042645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21194): Terminated: ok {rc=0} 03:37:56.088347 --- ParallelTerminationStrategy: PID 21197 died... 03:37:56.107700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21197): Terminated: ok {rc=0} 03:37:56.194093 bus /sierra_3: Setting Powered False 03:37:57.290641 bus /sierra_3: Setting Powered False 03:37:58.404461 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:37:59.544024 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:37:59.555487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:37:59.611544 tst mo_mt_call_osmux.py: using LAC 25720 03:37:59.728136 tst mo_mt_call_osmux.py: using RAC 220 03:37:59.843106 tst mo_mt_call_osmux.py: using CellId 25720 03:37:59.958355 tst mo_mt_call_osmux.py: using BVCI 25721 03:38:00.064398 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:00.075361 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:00.086081 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:00.096905 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:00.107926 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:00.118929 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:00.231879 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:00.347499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:00.845570 run create_hlr_db(pid=21200): Launched 03:38:01.018629 bus /sierra_2: Setting Powered False 03:38:02.090899 run create_hlr_db(pid=21200): Terminated: ok {rc=0} 03:38:02.528312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21202): Launched 03:38:02.822357 run osmo-hlr_10.42.42.2(pid=21203): Launched 03:38:02.933676 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:03.436820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21205): Launched 03:38:03.730327 run osmo-stp_10.42.42.5(pid=21206): Launched 03:38:03.841846 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:04.371050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21208): Launched 03:38:04.663980 run osmo-msc_10.42.42.6(pid=21209): Launched 03:38:04.828779 run osmo-stp_10.42.42.5(pid=21206): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21206)] 03:38:04.953587 run osmo-stp_10.42.42.5(pid=21206): stdout: | (launched: 2022-12-10_03:38:03.676283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:05.079025 run osmo-stp_10.42.42.5(pid=21206): stderr: | 20221210033803846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033803846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033803846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033803846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033803847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033803847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033803847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:05.202053 run osmo-stp_10.42.42.5(pid=21206): stdout: | (launched: 2022-12-10_03:38:03.676283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:05.318943 run osmo-stp_10.42.42.5(pid=21206): stderr: | 20221210033803846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033803846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033803846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033803846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033803847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033803847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033803847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:05.458999 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21206): Process ended prematurely: osmo-stp_10.42.42.5(pid=21206) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21206)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:38:05.467848 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:38:05.493940 run osmo-hlr_10.42.42.2(pid=21203): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21203)] 03:38:05.540787 run osmo-hlr_10.42.42.2(pid=21203): stdout: | (launched: 2022-12-10_03:38:02.768773) 03:38:05.589414 run osmo-hlr_10.42.42.2(pid=21203): stderr: | 20221210033802944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033802944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033802944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033802944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033802945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033802945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033802957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033802965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033802965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033802965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:05.656645 run osmo-msc_10.42.42.6(pid=21209): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21209)] 03:38:05.703542 run osmo-msc_10.42.42.6(pid=21209): stdout: | (launched: 2022-12-10_03:38:04.609693) 03:38:05.751854 run osmo-msc_10.42.42.6(pid=21209): stderr: | 20221210033804879 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033804879 DLGLOBAL DEBUG validating counter group 0x7fa440736c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033804879 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033804879 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033804879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033804880 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033804882 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033804882 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033804882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033804882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:05.800465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21202): Terminating (SIGTERM) 03:38:05.839581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21205): Terminating (SIGTERM) 03:38:05.878442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21208): Terminating (SIGTERM) 03:38:05.917539 --- ParallelTerminationStrategy: PID 21202 died... 03:38:05.936121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21202): Terminated: ok {rc=0} 03:38:05.979920 --- ParallelTerminationStrategy: PID 21205 died... 03:38:05.998189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21205): Terminated: ok {rc=0} 03:38:06.041455 --- ParallelTerminationStrategy: PID 21208 died... 03:38:06.059628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21208): Terminated: ok {rc=0} 03:38:06.143895 bus /sierra_3: Setting Powered False 03:38:07.242039 bus /sierra_3: Setting Powered False 03:38:08.357330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:38:09.587822 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:09.594228 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:38:09.615907 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:38:09.642468 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:38:09.693799 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:38:09.714242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:38:09.740636 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:38:10.289948 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:38:10.337373 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:10.348538 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:38:10.403712 tst mo_mt_call.py: using LAC 25721 03:38:10.520167 tst mo_mt_call.py: using RAC 221 03:38:10.634197 tst mo_mt_call.py: using CellId 25721 03:38:10.751786 tst mo_mt_call.py: using BVCI 25722 03:38:10.858572 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:10.869664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:10.880334 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:10.891389 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:10.902295 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:10.913354 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:11.029292 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:11.146246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:11.632841 run create_hlr_db(pid=21215): Launched 03:38:11.760856 bus /sierra_2: Setting Powered False 03:38:12.823620 run create_hlr_db(pid=21215): Terminated: ok {rc=0} 03:38:13.243195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21217): Launched 03:38:13.536497 run osmo-hlr_10.42.42.2(pid=21218): Launched 03:38:13.648120 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:14.165664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21220): Launched 03:38:14.458496 run osmo-stp_10.42.42.5(pid=21221): Launched 03:38:14.570290 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:15.101742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21223): Launched 03:38:15.396552 run osmo-msc_10.42.42.6(pid=21224): Launched 03:38:15.561323 run osmo-stp_10.42.42.5(pid=21221): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21221)] 03:38:15.686505 run osmo-stp_10.42.42.5(pid=21221): stdout: | (launched: 2022-12-10_03:38:14.404812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:15.812178 run osmo-stp_10.42.42.5(pid=21221): stderr: | 20221210033814572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033814572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033814573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033814573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033814574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033814574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033814574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:15.962833 run osmo-stp_10.42.42.5(pid=21221): stdout: | (launched: 2022-12-10_03:38:14.404812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:16.091406 run osmo-stp_10.42.42.5(pid=21221): stderr: | 20221210033814572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033814572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033814573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033814573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033814574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033814574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033814574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:16.278858 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21221): Process ended prematurely: osmo-stp_10.42.42.5(pid=21221) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21221)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:38:16.293352 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:38:16.324046 run osmo-hlr_10.42.42.2(pid=21218): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21218)] 03:38:16.385843 run osmo-hlr_10.42.42.2(pid=21218): stdout: | (launched: 2022-12-10_03:38:13.482494) 03:38:16.447697 run osmo-hlr_10.42.42.2(pid=21218): stderr: | 20221210033813657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033813657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033813657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033813657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033813657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033813657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033813669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033813677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033813678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033813678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:16.535594 run osmo-msc_10.42.42.6(pid=21224): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21224)] 03:38:16.589752 run osmo-msc_10.42.42.6(pid=21224): stdout: | (launched: 2022-12-10_03:38:15.342371) 03:38:16.656869 run osmo-msc_10.42.42.6(pid=21224): stderr: | 20221210033815613 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033815613 DLGLOBAL DEBUG validating counter group 0x7fb45bc49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033815613 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033815613 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033815613 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033815613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033815615 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033815615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033815615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033815616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:16.711350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21217): Terminating (SIGTERM) 03:38:16.756129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21220): Terminating (SIGTERM) 03:38:16.799819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21223): Terminating (SIGTERM) 03:38:16.843605 --- ParallelTerminationStrategy: PID 21217 died... 03:38:16.864578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21217): Terminated: ok {rc=0} 03:38:16.911822 --- ParallelTerminationStrategy: PID 21220 died... 03:38:16.931477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21220): Terminated: ok {rc=0} 03:38:16.978055 --- ParallelTerminationStrategy: PID 21223 died... 03:38:16.997950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21223): Terminated: ok {rc=0} 03:38:17.102929 bus /sierra_3: Setting Powered False 03:38:18.224658 bus /sierra_3: Setting Powered False 03:38:19.356070 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:38:20.501210 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:20.513742 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:38:20.572514 tst mo_mt_call_osmux.py: using LAC 25722 03:38:20.698537 tst mo_mt_call_osmux.py: using RAC 222 03:38:20.820425 tst mo_mt_call_osmux.py: using CellId 25722 03:38:20.942508 tst mo_mt_call_osmux.py: using BVCI 25723 03:38:21.057454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:21.069803 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:21.082176 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:21.094622 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:21.107383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:21.120036 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:21.241436 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:21.360581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:21.859301 run create_hlr_db(pid=21497): Launched 03:38:22.021781 bus /sierra_2: Setting Powered False 03:38:23.085323 run create_hlr_db(pid=21497): Terminated: ok {rc=0} 03:38:23.541040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21499): Launched 03:38:23.880756 run osmo-hlr_10.42.42.2(pid=21500): Launched 03:38:24.116608 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:24.793685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21502): Launched 03:38:25.128804 run osmo-stp_10.42.42.5(pid=21503): Launched 03:38:25.373615 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:26.045710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21505): Launched 03:38:26.382885 run osmo-msc_10.42.42.6(pid=21506): Launched 03:38:26.742649 run osmo-stp_10.42.42.5(pid=21503): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21503)] 03:38:27.020538 run osmo-stp_10.42.42.5(pid=21503): stdout: | (launched: 2022-12-10_03:38:25.064028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:27.193381 run osmo-stp_10.42.42.5(pid=21503): stderr: | 20221210033825361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033825361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033825362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033825362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033825363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033825363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033825363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:27.327927 run osmo-stp_10.42.42.5(pid=21503): stdout: | (launched: 2022-12-10_03:38:25.064028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:27.457931 run osmo-stp_10.42.42.5(pid=21503): stderr: | 20221210033825361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033825361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033825362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033825362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033825363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033825363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033825363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:27.611820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21503): Process ended prematurely: osmo-stp_10.42.42.5(pid=21503) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21503)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:38:27.622586 tst mo_mt_call_osmux.py:8: Test FAILED (7.2 sec) 03:38:27.651955 run osmo-hlr_10.42.42.2(pid=21500): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21500)] 03:38:27.705386 run osmo-hlr_10.42.42.2(pid=21500): stdout: | (launched: 2022-12-10_03:38:23.815407) 03:38:27.758891 run osmo-hlr_10.42.42.2(pid=21500): stderr: | 20221210033824125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033824125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033824125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033824125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033824125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033824125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033824143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033824159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033824160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033824160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:27.832825 run osmo-msc_10.42.42.6(pid=21506): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21506)] 03:38:27.885180 run osmo-msc_10.42.42.6(pid=21506): stdout: | (launched: 2022-12-10_03:38:26.318486) 03:38:27.938734 run osmo-msc_10.42.42.6(pid=21506): stderr: | 20221210033826824 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033826824 DLGLOBAL DEBUG validating counter group 0x7f86fe3cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033826824 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033826824 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033826824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033826833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033826835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033826835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033826835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033826835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:27.992145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21499): Terminating (SIGTERM) 03:38:28.035434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21502): Terminating (SIGTERM) 03:38:28.081432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21505): Terminating (SIGTERM) 03:38:28.126564 --- ParallelTerminationStrategy: PID 21499 died... 03:38:28.146863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21499): Terminated: ok {rc=0} 03:38:28.195911 --- ParallelTerminationStrategy: PID 21502 died... 03:38:28.216216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21502): Terminated: ok {rc=0} 03:38:28.263816 --- ParallelTerminationStrategy: PID 21505 died... 03:38:28.283773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21505): Terminated: ok {rc=0} 03:38:28.373550 bus /sierra_3: Setting Powered False 03:38:29.477206 bus /sierra_3: Setting Powered False 03:38:30.596722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:38:31.892062 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:31.900438 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:38:31.925578 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:38:31.958299 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:38:32.018237 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:38:32.058001 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:38:32.104435 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:38:32.637152 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:38:32.691304 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:32.704062 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:38:32.761605 tst mo_mt_call.py: using LAC 25723 03:38:32.888022 tst mo_mt_call.py: using RAC 223 03:38:33.026602 tst mo_mt_call.py: using CellId 25723 03:38:33.161521 tst mo_mt_call.py: using BVCI 25724 03:38:33.282893 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:33.295321 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:33.307479 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:33.319682 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:33.332044 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:33.344691 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:33.466328 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:33.576409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:34.048942 run create_hlr_db(pid=21511): Launched 03:38:34.196387 bus /sierra_2: Setting Powered False 03:38:35.257495 run create_hlr_db(pid=21511): Terminated: ok {rc=0} 03:38:35.697888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21513): Launched 03:38:36.025651 run osmo-hlr_10.42.42.2(pid=21514): Launched 03:38:36.259276 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:36.996676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21516): Launched 03:38:37.326547 run osmo-stp_10.42.42.5(pid=21517): Launched 03:38:37.564389 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:38.299815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21519): Launched 03:38:38.615242 run osmo-msc_10.42.42.6(pid=21521): Launched 03:38:38.789288 run osmo-stp_10.42.42.5(pid=21517): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21517)] 03:38:38.920679 run osmo-stp_10.42.42.5(pid=21517): stdout: | (launched: 2022-12-10_03:38:37.255766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:39.051891 run osmo-stp_10.42.42.5(pid=21517): stderr: | 20221210033837587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033837587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033837587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033837587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033837588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033837588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033837588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:39.183442 run osmo-stp_10.42.42.5(pid=21517): stdout: | (launched: 2022-12-10_03:38:37.255766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:39.308370 run osmo-stp_10.42.42.5(pid=21517): stderr: | 20221210033837587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033837587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033837587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033837587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033837588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033837588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033837588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:39.457823 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21517): Process ended prematurely: osmo-stp_10.42.42.5(pid=21517) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21517)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:38:39.467277 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 03:38:39.494571 run osmo-hlr_10.42.42.2(pid=21514): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21514)] 03:38:39.543778 run osmo-hlr_10.42.42.2(pid=21514): stdout: | (launched: 2022-12-10_03:38:35.956847) 03:38:39.594834 run osmo-hlr_10.42.42.2(pid=21514): stderr: | 20221210033836307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033836307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033836307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033836307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033836307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033836307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033836331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033836343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033836344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033836344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:39.666002 run osmo-msc_10.42.42.6(pid=21521): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21521)] 03:38:39.715629 run osmo-msc_10.42.42.6(pid=21521): stdout: | (launched: 2022-12-10_03:38:38.558453) 03:38:39.766716 run osmo-msc_10.42.42.6(pid=21521): stderr: | 20221210033838880 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033838881 DLGLOBAL DEBUG validating counter group 0x7efde8e5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033838881 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033838881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033838881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033838881 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033838883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033838883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033838883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033838883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:39.818211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21513): Terminating (SIGTERM) 03:38:39.859104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21516): Terminating (SIGTERM) 03:38:39.900149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21519): Terminating (SIGTERM) 03:38:39.941482 --- ParallelTerminationStrategy: PID 21513 died... 03:38:39.960891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21513): Terminated: ok {rc=0} 03:38:40.006469 --- ParallelTerminationStrategy: PID 21516 died... 03:38:40.025711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21516): Terminated: ok {rc=0} 03:38:40.071007 --- ParallelTerminationStrategy: PID 21519 died... 03:38:40.090167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21519): Terminated: ok {rc=0} 03:38:40.176547 bus /sierra_3: Setting Powered False 03:38:41.275879 bus /sierra_3: Setting Powered False 03:38:42.390207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:38:43.532291 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:43.543838 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:38:43.599976 tst mo_mt_call_osmux.py: using LAC 25724 03:38:43.716618 tst mo_mt_call_osmux.py: using RAC 224 03:38:43.832098 tst mo_mt_call_osmux.py: using CellId 25724 03:38:43.947965 tst mo_mt_call_osmux.py: using BVCI 25725 03:38:44.054556 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:44.065452 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:44.075994 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:44.086802 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:44.097882 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:44.108859 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:44.224655 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:44.337288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:44.793034 run create_hlr_db(pid=21523): Launched 03:38:44.904374 bus /sierra_2: Setting Powered False 03:38:45.965403 run create_hlr_db(pid=21523): Terminated: ok {rc=0} 03:38:46.416641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21525): Launched 03:38:46.758036 run osmo-hlr_10.42.42.2(pid=21526): Launched 03:38:46.898292 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:47.600571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21528): Launched 03:38:47.894346 run osmo-stp_10.42.42.5(pid=21529): Launched 03:38:48.006248 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:48.537523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21531): Launched 03:38:48.830718 run osmo-msc_10.42.42.6(pid=21532): Launched 03:38:48.994587 run osmo-stp_10.42.42.5(pid=21529): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21529)] 03:38:49.118774 run osmo-stp_10.42.42.5(pid=21529): stdout: | (launched: 2022-12-10_03:38:47.840663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:49.243875 run osmo-stp_10.42.42.5(pid=21529): stderr: | 20221210033848009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033848009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033848009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033848010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033848010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033848010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033848010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:49.366527 run osmo-stp_10.42.42.5(pid=21529): stdout: | (launched: 2022-12-10_03:38:47.840663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:49.483214 run osmo-stp_10.42.42.5(pid=21529): stderr: | 20221210033848009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033848009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033848009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033848010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033848010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033848010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033848010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:49.623422 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21529): Process ended prematurely: osmo-stp_10.42.42.5(pid=21529) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21529)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:38:49.632412 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:38:49.658800 run osmo-hlr_10.42.42.2(pid=21526): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21526)] 03:38:49.706008 run osmo-hlr_10.42.42.2(pid=21526): stdout: | (launched: 2022-12-10_03:38:46.688788) 03:38:49.754546 run osmo-hlr_10.42.42.2(pid=21526): stderr: | 20221210033847004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033847004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033847004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033847004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033847004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033847004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033847018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033847038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033847038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033847038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:49.822797 run osmo-msc_10.42.42.6(pid=21532): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21532)] 03:38:49.869962 run osmo-msc_10.42.42.6(pid=21532): stdout: | (launched: 2022-12-10_03:38:48.776680) 03:38:49.918750 run osmo-msc_10.42.42.6(pid=21532): stderr: | 20221210033849046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033849046 DLGLOBAL DEBUG validating counter group 0x7fb23cfdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033849046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033849046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033849047 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033849047 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033849048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033849049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033849049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033849049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:49.967907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21525): Terminating (SIGTERM) 03:38:50.007030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21528): Terminating (SIGTERM) 03:38:50.046225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21531): Terminating (SIGTERM) 03:38:50.085594 --- ParallelTerminationStrategy: PID 21525 died... 03:38:50.104386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21525): Terminated: ok {rc=0} 03:38:50.147868 --- ParallelTerminationStrategy: PID 21528 died... 03:38:50.165983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21528): Terminated: ok {rc=0} 03:38:50.209325 --- ParallelTerminationStrategy: PID 21531 died... 03:38:50.227592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21531): Terminated: ok {rc=0} 03:38:50.313321 bus /sierra_3: Setting Powered False 03:38:51.410853 bus /sierra_3: Setting Powered False 03:38:52.522141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:38:53.746340 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:53.752545 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:38:53.773631 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:38:53.800680 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:38:53.850556 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:38:53.870904 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:38:53.897419 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:38:54.449510 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:38:54.498069 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:38:54.509184 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:38:54.565386 tst mo_mt_call.py: using LAC 25725 03:38:54.688246 tst mo_mt_call.py: using RAC 225 03:38:54.810593 tst mo_mt_call.py: using CellId 25725 03:38:54.933950 tst mo_mt_call.py: using BVCI 25726 03:38:55.047812 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:38:55.059513 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:38:55.070741 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:38:55.082000 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:38:55.093299 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:38:55.104476 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:38:55.217820 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:38:55.330280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:55.784445 run create_hlr_db(pid=21537): Launched 03:38:55.897237 bus /sierra_2: Setting Powered False 03:38:56.956290 run create_hlr_db(pid=21537): Terminated: ok {rc=0} 03:38:57.365279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21539): Launched 03:38:57.658011 run osmo-hlr_10.42.42.2(pid=21540): Launched 03:38:57.782893 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:58.326919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21542): Launched 03:38:58.640406 run osmo-stp_10.42.42.5(pid=21543): Launched 03:38:58.761285 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:59.329058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21545): Launched 03:38:59.643616 run osmo-msc_10.42.42.6(pid=21546): Launched 03:38:59.820543 run osmo-stp_10.42.42.5(pid=21543): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21543)] 03:38:59.953618 run osmo-stp_10.42.42.5(pid=21543): stdout: | (launched: 2022-12-10_03:38:58.583376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:00.086604 run osmo-stp_10.42.42.5(pid=21543): stderr: | 20221210033858777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033858777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033858777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033858778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033858778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033858778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033858778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:00.219040 run osmo-stp_10.42.42.5(pid=21543): stdout: | (launched: 2022-12-10_03:38:58.583376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:00.344562 run osmo-stp_10.42.42.5(pid=21543): stderr: | 20221210033858777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033858777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033858777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033858778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033858778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033858778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033858778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:00.494952 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21543): Process ended prematurely: osmo-stp_10.42.42.5(pid=21543) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21543)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:39:00.504447 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:39:00.531851 run osmo-hlr_10.42.42.2(pid=21540): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21540)] 03:39:00.581449 run osmo-hlr_10.42.42.2(pid=21540): stdout: | (launched: 2022-12-10_03:38:57.604460) 03:39:00.632754 run osmo-hlr_10.42.42.2(pid=21540): stderr: | 20221210033857800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033857800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033857800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033857800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033857800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033857801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033857813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033857822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033857822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033857822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:00.703849 run osmo-msc_10.42.42.6(pid=21546): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21546)] 03:39:00.753299 run osmo-msc_10.42.42.6(pid=21546): stdout: | (launched: 2022-12-10_03:38:59.586166) 03:39:00.804359 run osmo-msc_10.42.42.6(pid=21546): stderr: | 20221210033859907 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033859907 DLGLOBAL DEBUG validating counter group 0x7f1bd1ddfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033859907 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033859907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033859907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033859907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033859909 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033859910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033859910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033859910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:00.873258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21539): Terminating (SIGTERM) 03:39:00.929785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21542): Terminating (SIGTERM) 03:39:00.974092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21545): Terminating (SIGTERM) 03:39:01.018604 --- ParallelTerminationStrategy: PID 21539 died... 03:39:01.041249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21539): Terminated: ok {rc=0} 03:39:01.092043 --- ParallelTerminationStrategy: PID 21542 died... 03:39:01.111688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21542): Terminated: ok {rc=0} 03:39:01.159315 --- ParallelTerminationStrategy: PID 21545 died... 03:39:01.178710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21545): Terminated: ok {rc=0} 03:39:01.268869 bus /sierra_3: Setting Powered False 03:39:02.365625 bus /sierra_3: Setting Powered False 03:39:03.479238 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:39:04.625530 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:04.637646 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:39:04.696087 tst mo_mt_call_osmux.py: using LAC 25726 03:39:04.820938 tst mo_mt_call_osmux.py: using RAC 226 03:39:04.943626 tst mo_mt_call_osmux.py: using CellId 25726 03:39:05.061115 tst mo_mt_call_osmux.py: using BVCI 25727 03:39:05.169080 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:05.180305 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:05.191027 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:05.202041 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:05.213147 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:05.224125 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:05.341228 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:05.461574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:05.947010 run create_hlr_db(pid=21548): Launched 03:39:06.074142 bus /sierra_2: Setting Powered False 03:39:07.136588 run create_hlr_db(pid=21548): Terminated: ok {rc=0} 03:39:07.555679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21550): Launched 03:39:07.849101 run osmo-hlr_10.42.42.2(pid=21551): Launched 03:39:07.960751 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:08.499138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21553): Launched 03:39:08.811834 run osmo-stp_10.42.42.5(pid=21554): Launched 03:39:08.930579 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:09.496518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21556): Launched 03:39:09.810700 run osmo-msc_10.42.42.6(pid=21557): Launched 03:39:09.984625 run osmo-stp_10.42.42.5(pid=21554): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21554)] 03:39:10.116262 run osmo-stp_10.42.42.5(pid=21554): stdout: | (launched: 2022-12-10_03:39:08.754818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:10.249089 run osmo-stp_10.42.42.5(pid=21554): stderr: | 20221210033908947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033908947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033908947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033908947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033908948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033908948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033908948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:10.380800 run osmo-stp_10.42.42.5(pid=21554): stdout: | (launched: 2022-12-10_03:39:08.754818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:10.505901 run osmo-stp_10.42.42.5(pid=21554): stderr: | 20221210033908947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033908947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033908947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033908947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033908948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033908948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033908948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:10.655397 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21554): Process ended prematurely: osmo-stp_10.42.42.5(pid=21554) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21554)] [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:39:10.664879 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:39:10.691969 run osmo-hlr_10.42.42.2(pid=21551): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21551)] 03:39:10.741232 run osmo-hlr_10.42.42.2(pid=21551): stdout: | (launched: 2022-12-10_03:39:07.795624) 03:39:10.791960 run osmo-hlr_10.42.42.2(pid=21551): stderr: | 20221210033907972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033907972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033907973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033907973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033907973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033907973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033907984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033907992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033907992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033907992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:10.862427 run osmo-msc_10.42.42.6(pid=21557): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21557)] 03:39:10.911350 run osmo-msc_10.42.42.6(pid=21557): stdout: | (launched: 2022-12-10_03:39:09.753691) 03:39:10.961971 run osmo-msc_10.42.42.6(pid=21557): stderr: | 20221210033910074 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033910075 DLGLOBAL DEBUG validating counter group 0x7ff978441c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033910075 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033910075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033910075 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033910075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033910077 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033910077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033910077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033910078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:11.012739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21550): Terminating (SIGTERM) 03:39:11.053367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21553): Terminating (SIGTERM) 03:39:11.093938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21556): Terminating (SIGTERM) 03:39:11.134800 --- ParallelTerminationStrategy: PID 21550 died... 03:39:11.154550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21550): Terminated: ok {rc=0} 03:39:11.199822 --- ParallelTerminationStrategy: PID 21553 died... 03:39:11.218776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21553): Terminated: ok {rc=0} 03:39:11.263782 --- ParallelTerminationStrategy: PID 21556 died... 03:39:11.282744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21556): Terminated: ok {rc=0} 03:39:11.368156 bus /sierra_3: Setting Powered False 03:39:12.464052 bus /sierra_3: Setting Powered False 03:39:13.577327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:39:14.807506 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:14.813869 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:39:14.834462 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:39:14.861001 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:39:14.912869 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:39:14.934037 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:39:14.960513 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:39:15.509383 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:39:15.556398 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:15.567503 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:39:15.624072 tst mo_mt_call.py: using LAC 25727 03:39:15.738221 tst mo_mt_call.py: using RAC 227 03:39:15.870205 tst mo_mt_call.py: using CellId 25727 03:39:16.003455 tst mo_mt_call.py: using BVCI 25728 03:39:16.113314 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:16.124548 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:16.135502 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:16.147871 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:16.160117 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:16.172548 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:16.289054 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:16.426673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:16.938457 run create_hlr_db(pid=21562): Launched 03:39:17.099185 bus /sierra_2: Setting Powered False 03:39:18.161886 run create_hlr_db(pid=21562): Terminated: ok {rc=0} 03:39:18.600146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Launched 03:39:18.914381 run osmo-hlr_10.42.42.2(pid=21565): Launched 03:39:19.033201 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:19.576922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Launched 03:39:19.891131 run osmo-stp_10.42.42.5(pid=21568): Launched 03:39:20.010201 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:20.577615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21570): Launched 03:39:20.892112 run osmo-msc_10.42.42.6(pid=21571): Launched 03:39:21.067511 run osmo-stp_10.42.42.5(pid=21568): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] 03:39:21.200934 run osmo-stp_10.42.42.5(pid=21568): stdout: | (launched: 2022-12-10_03:39:19.833782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:21.334775 run osmo-stp_10.42.42.5(pid=21568): stderr: | 20221210033920023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033920023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033920023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033920024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033920024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033920024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033920024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:21.467091 run osmo-stp_10.42.42.5(pid=21568): stdout: | (launched: 2022-12-10_03:39:19.833782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:21.592500 run osmo-stp_10.42.42.5(pid=21568): stderr: | 20221210033920023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033920023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033920023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033920024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033920024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033920024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033920024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:21.742592 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21568): Process ended prematurely: osmo-stp_10.42.42.5(pid=21568) [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:39:21.752135 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:39:21.779503 run osmo-hlr_10.42.42.2(pid=21565): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21565)] 03:39:21.828848 run osmo-hlr_10.42.42.2(pid=21565): stdout: | (launched: 2022-12-10_03:39:18.857308) 03:39:21.879744 run osmo-hlr_10.42.42.2(pid=21565): stderr: | 20221210033919055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033919055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033919055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033919055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033919055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033919055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033919068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033919076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033919076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033919076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:21.950820 run osmo-msc_10.42.42.6(pid=21571): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21571)] 03:39:22.000076 run osmo-msc_10.42.42.6(pid=21571): stdout: | (launched: 2022-12-10_03:39:20.834905) 03:39:22.051074 run osmo-msc_10.42.42.6(pid=21571): stderr: | 20221210033921156 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033921156 DLGLOBAL DEBUG validating counter group 0x7f13946cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033921156 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033921156 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033921156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033921156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033921158 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033921158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033921159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033921159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:22.102250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Terminating (SIGTERM) 03:39:22.143393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Terminating (SIGTERM) 03:39:22.184606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21570): Terminating (SIGTERM) 03:39:22.225941 --- ParallelTerminationStrategy: PID 21564 died... 03:39:22.245538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21564): Terminated: ok {rc=0} 03:39:22.291094 --- ParallelTerminationStrategy: PID 21567 died... 03:39:22.310442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21567): Terminated: ok {rc=0} 03:39:22.356017 --- ParallelTerminationStrategy: PID 21570 died... 03:39:22.375237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21570): Terminated: ok {rc=0} 03:39:22.462026 bus /sierra_3: Setting Powered False 03:39:23.560855 bus /sierra_3: Setting Powered False 03:39:24.675825 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:39:25.815832 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:25.827378 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:39:25.886963 tst mo_mt_call_osmux.py: using LAC 25728 03:39:26.001208 tst mo_mt_call_osmux.py: using RAC 228 03:39:26.114298 tst mo_mt_call_osmux.py: using CellId 25728 03:39:26.229011 tst mo_mt_call_osmux.py: using BVCI 25729 03:39:26.343779 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:26.355501 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:26.366978 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:26.378477 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:26.389990 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:26.401456 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:26.515835 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:26.633429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:27.119518 run create_hlr_db(pid=21573): Launched 03:39:27.246193 bus /sierra_2: Setting Powered False 03:39:28.309084 run create_hlr_db(pid=21573): Terminated: ok {rc=0} 03:39:28.746458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21575): Launched 03:39:29.059760 run osmo-hlr_10.42.42.2(pid=21576): Launched 03:39:29.178939 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:29.722577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21578): Launched 03:39:30.035851 run osmo-stp_10.42.42.5(pid=21579): Launched 03:39:30.155190 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:30.722518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21581): Launched 03:39:31.063813 run osmo-msc_10.42.42.6(pid=21582): Launched 03:39:31.496352 run osmo-stp_10.42.42.5(pid=21579): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21579)] 03:39:31.650214 run osmo-stp_10.42.42.5(pid=21579): stdout: | (launched: 2022-12-10_03:39:29.978884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:31.813357 run osmo-stp_10.42.42.5(pid=21579): stderr: | 20221210033930170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033930170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033930170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033930170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033930171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033930171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033930171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:31.947019 run osmo-stp_10.42.42.5(pid=21579): stdout: | (launched: 2022-12-10_03:39:29.978884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:32.074539 run osmo-stp_10.42.42.5(pid=21579): stderr: | 20221210033930170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033930170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033930170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033930170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033930171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033930171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033930171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:32.226738 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21579): Process ended prematurely: osmo-stp_10.42.42.5(pid=21579) [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21579)] [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:39:32.236828 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:39:32.265055 run osmo-hlr_10.42.42.2(pid=21576): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21576)] 03:39:32.315246 run osmo-hlr_10.42.42.2(pid=21576): stdout: | (launched: 2022-12-10_03:39:29.002797) 03:39:32.367170 run osmo-hlr_10.42.42.2(pid=21576): stderr: | 20221210033929200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033929200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033929200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033929200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033929201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033929201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033929214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033929222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033929223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033929223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:32.438426 run osmo-msc_10.42.42.6(pid=21582): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21582)] 03:39:32.487426 run osmo-msc_10.42.42.6(pid=21582): stdout: | (launched: 2022-12-10_03:39:30.999112) 03:39:32.537870 run osmo-msc_10.42.42.6(pid=21582): stderr: | 20221210033931360 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033931360 DLGLOBAL DEBUG validating counter group 0x7f0d786dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033931360 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033931361 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033931361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033931361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033931364 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033931364 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033931365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033931365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:32.588578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21575): Terminating (SIGTERM) 03:39:32.629493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21578): Terminating (SIGTERM) 03:39:32.670280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21581): Terminating (SIGTERM) 03:39:32.711158 --- ParallelTerminationStrategy: PID 21575 died... 03:39:32.730730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21575): Terminated: ok {rc=0} 03:39:32.776462 --- ParallelTerminationStrategy: PID 21578 died... 03:39:32.795721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21578): Terminated: ok {rc=0} 03:39:32.840761 --- ParallelTerminationStrategy: PID 21581 died... 03:39:32.859794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21581): Terminated: ok {rc=0} 03:39:32.945730 bus /sierra_3: Setting Powered False 03:39:34.042214 bus /sierra_3: Setting Powered False 03:39:35.155830 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:39:36.390884 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:36.397454 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:39:36.418847 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:39:36.446579 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:39:36.499189 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:39:36.521424 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:39:36.547896 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:39:37.097179 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:39:37.146170 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:37.156769 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:39:37.211006 tst mo_mt_call.py: using LAC 25729 03:39:37.326338 tst mo_mt_call.py: using RAC 229 03:39:37.439954 tst mo_mt_call.py: using CellId 25729 03:39:37.553375 tst mo_mt_call.py: using BVCI 25730 03:39:37.659555 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:37.670542 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:37.681137 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:37.691903 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:37.702720 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:37.713717 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:39:37.828599 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:39:37.943983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:38.397651 run create_hlr_db(pid=21587): Launched 03:39:38.508316 bus /sierra_2: Setting Powered False 03:39:39.567752 run create_hlr_db(pid=21587): Terminated: ok {rc=0} 03:39:39.977369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21589): Launched 03:39:40.269789 run osmo-hlr_10.42.42.2(pid=21590): Launched 03:39:40.381464 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:40.885621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21592): Launched 03:39:41.179884 run osmo-stp_10.42.42.5(pid=21593): Launched 03:39:41.292574 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:41.826733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21595): Launched 03:39:42.121386 run osmo-msc_10.42.42.6(pid=21596): Launched 03:39:42.285808 run osmo-stp_10.42.42.5(pid=21593): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21593)] 03:39:42.410320 run osmo-stp_10.42.42.5(pid=21593): stdout: | (launched: 2022-12-10_03:39:41.126243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:42.535803 run osmo-stp_10.42.42.5(pid=21593): stderr: | 20221210033941295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033941296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033941296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033941296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033941297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033941297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033941297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:42.657967 run osmo-stp_10.42.42.5(pid=21593): stdout: | (launched: 2022-12-10_03:39:41.126243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:42.775080 run osmo-stp_10.42.42.5(pid=21593): stderr: | 20221210033941295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033941296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033941296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033941296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033941297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033941297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033941297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:42.914899 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21593): Process ended prematurely: osmo-stp_10.42.42.5(pid=21593) [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21593)] [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:39:42.923622 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 03:39:42.949714 run osmo-hlr_10.42.42.2(pid=21590): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21590)] 03:39:42.996938 run osmo-hlr_10.42.42.2(pid=21590): stdout: | (launched: 2022-12-10_03:39:40.216542) 03:39:43.045700 run osmo-hlr_10.42.42.2(pid=21590): stderr: | 20221210033940392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033940392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033940392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033940392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033940392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033940392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033940403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033940412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033940412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033940412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:43.113479 run osmo-msc_10.42.42.6(pid=21596): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21596)] 03:39:43.160024 run osmo-msc_10.42.42.6(pid=21596): stdout: | (launched: 2022-12-10_03:39:42.067193) 03:39:43.208613 run osmo-msc_10.42.42.6(pid=21596): stderr: | 20221210033942340 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033942340 DLGLOBAL DEBUG validating counter group 0x7fc59b65ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033942340 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033942340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033942340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033942340 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033942342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033942343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033942343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033942343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:43.257633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21589): Terminating (SIGTERM) 03:39:43.296569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21592): Terminating (SIGTERM) 03:39:43.335474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21595): Terminating (SIGTERM) 03:39:43.374595 --- ParallelTerminationStrategy: PID 21589 died... 03:39:43.393154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21589): Terminated: ok {rc=0} 03:39:43.437349 --- ParallelTerminationStrategy: PID 21592 died... 03:39:43.455345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21592): Terminated: ok {rc=0} 03:39:43.498953 --- ParallelTerminationStrategy: PID 21595 died... 03:39:43.517073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21595): Terminated: ok {rc=0} 03:39:43.599329 bus /sierra_3: Setting Powered False 03:39:44.695444 bus /sierra_3: Setting Powered False 03:39:45.809958 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:39:46.961138 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:46.974055 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:39:47.032422 tst mo_mt_call_osmux.py: using LAC 25730 03:39:47.152107 tst mo_mt_call_osmux.py: using RAC 230 03:39:47.283753 tst mo_mt_call_osmux.py: using CellId 25730 03:39:47.407448 tst mo_mt_call_osmux.py: using BVCI 25731 03:39:47.521739 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:47.533636 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:47.544783 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:47.556027 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:47.567244 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:47.578695 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:39:47.695997 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:39:47.810761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:48.266810 run create_hlr_db(pid=21598): Launched 03:39:48.393537 bus /sierra_2: Setting Powered False 03:39:49.456476 run create_hlr_db(pid=21598): Terminated: ok {rc=0} 03:39:49.896277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21600): Launched 03:39:50.210115 run osmo-hlr_10.42.42.2(pid=21601): Launched 03:39:50.328893 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:50.869169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21603): Launched 03:39:51.182531 run osmo-stp_10.42.42.5(pid=21604): Launched 03:39:51.301666 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:51.870391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21606): Launched 03:39:52.183411 run osmo-msc_10.42.42.6(pid=21607): Launched 03:39:52.357584 run osmo-stp_10.42.42.5(pid=21604): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21604)] 03:39:52.489673 run osmo-stp_10.42.42.5(pid=21604): stdout: | (launched: 2022-12-10_03:39:51.125815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:52.622441 run osmo-stp_10.42.42.5(pid=21604): stderr: | 20221210033951317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033951317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033951317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033951318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033951318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033951318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033951318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:52.755001 run osmo-stp_10.42.42.5(pid=21604): stdout: | (launched: 2022-12-10_03:39:51.125815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:52.879894 run osmo-stp_10.42.42.5(pid=21604): stderr: | 20221210033951317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210033951317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210033951317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210033951318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033951318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033951318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033951318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:53.028756 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21604): Process ended prematurely: osmo-stp_10.42.42.5(pid=21604) [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21604)] [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:39:53.038502 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:39:53.065768 run osmo-hlr_10.42.42.2(pid=21601): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21601)] 03:39:53.114899 run osmo-hlr_10.42.42.2(pid=21601): stdout: | (launched: 2022-12-10_03:39:50.152808) 03:39:53.165759 run osmo-hlr_10.42.42.2(pid=21601): stderr: | 20221210033950351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210033950351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210033950351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210033950351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210033950352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210033950352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210033950368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210033950379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033950379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033950379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:53.236065 run osmo-msc_10.42.42.6(pid=21607): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21607)] 03:39:53.285068 run osmo-msc_10.42.42.6(pid=21607): stdout: | (launched: 2022-12-10_03:39:52.126342) 03:39:53.335582 run osmo-msc_10.42.42.6(pid=21607): stderr: | 20221210033952448 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210033952448 DLGLOBAL DEBUG validating counter group 0x7f3621f1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210033952449 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210033952449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210033952449 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210033952449 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210033952451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210033952451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033952451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033952451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:53.386439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21600): Terminating (SIGTERM) 03:39:53.427013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21603): Terminating (SIGTERM) 03:39:53.467526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21606): Terminating (SIGTERM) 03:39:53.508679 --- ParallelTerminationStrategy: PID 21600 died... 03:39:53.528225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21600): Terminated: ok {rc=0} 03:39:53.573289 --- ParallelTerminationStrategy: PID 21603 died... 03:39:53.592459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21603): Terminated: ok {rc=0} 03:39:53.637781 --- ParallelTerminationStrategy: PID 21606 died... 03:39:53.657097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21606): Terminated: ok {rc=0} 03:39:53.743010 bus /sierra_3: Setting Powered False 03:39:54.842195 bus /sierra_3: Setting Powered False 03:39:55.957971 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:sysmo --------------------------------------------------------------------- 03:39:57.185190 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:57.190453 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 03:39:57.211755 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 03:39:57.238931 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 03:39:57.325851 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 03:39:57.347561 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 03:39:57.374976 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 03:39:57.957280 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 03:39:57.962209 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:39:57.973139 tst emergency:sysmo: Using 1 x bts (candidates: 1) 03:39:58.009382 tst emergency_mo_mt_call.py: using LAC 25731 03:39:58.133230 tst emergency_mo_mt_call.py: using RAC 231 03:39:58.254182 tst emergency_mo_mt_call.py: using CellId 25731 03:39:58.374923 tst emergency_mo_mt_call.py: using BVCI 25732 03:39:58.486723 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:39:58.497859 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:39:58.508866 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:39:58.519832 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:39:58.530675 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:39:58.541725 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:39:58.653475 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:39:58.764157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:59.209662 run create_hlr_db(pid=21612): Launched 03:39:59.318931 bus /sierra_2: Setting Powered False 03:40:00.377128 run create_hlr_db(pid=21612): Terminated: ok {rc=0} 03:40:00.779863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21614): Launched 03:40:01.123839 run osmo-hlr_10.42.42.2(pid=21615): Launched 03:40:01.353349 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:02.090100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21621): Launched 03:40:02.397666 run osmo-stp_10.42.42.5(pid=21625): Launched 03:40:02.636646 tst emergency_mo_mt_call.py: using MSISDN 7537 03:40:02.799572 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:03.355664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Launched 03:40:03.663897 run osmo-msc_10.42.42.6(pid=21631): Launched 03:40:03.836502 run osmo-stp_10.42.42.5(pid=21625): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21625)] 03:40:03.966059 run osmo-stp_10.42.42.5(pid=21625): stdout: | (launched: 2022-12-10_03:40:02.331787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:04.097303 run osmo-stp_10.42.42.5(pid=21625): stderr: | 20221210034002657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034002657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034002657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034002658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034002658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034002658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034002658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:04.227492 run osmo-stp_10.42.42.5(pid=21625): stdout: | (launched: 2022-12-10_03:40:02.331787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:04.352575 run osmo-stp_10.42.42.5(pid=21625): stderr: | 20221210034002657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034002657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034002657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034002658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034002658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034002658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034002658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:04.499248 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21625): Process ended prematurely: osmo-stp_10.42.42.5(pid=21625) [trial-2369↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21625)] [trial-2369↪emergency:sysmo↪emergency_mo_mt_call.py:19] 03:40:04.508285 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 03:40:04.535721 run osmo-hlr_10.42.42.2(pid=21615): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21615)] 03:40:04.584875 run osmo-hlr_10.42.42.2(pid=21615): stdout: | (launched: 2022-12-10_03:40:01.056519) 03:40:04.635737 run osmo-hlr_10.42.42.2(pid=21615): stderr: | 20221210034001402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034001402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034001402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034001402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034001402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034001403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034001425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034001442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034001442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034001442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:04.706434 run osmo-msc_10.42.42.6(pid=21631): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21631)] 03:40:04.755487 run osmo-msc_10.42.42.6(pid=21631): stdout: | (launched: 2022-12-10_03:40:03.607567) 03:40:04.806547 run osmo-msc_10.42.42.6(pid=21631): stderr: | 20221210034003930 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034003930 DLGLOBAL DEBUG validating counter group 0x7f1149fb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034003930 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034003930 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034003930 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034003930 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034003932 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034003933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034003933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034003933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:04.857786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21614): Terminating (SIGTERM) 03:40:04.898754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21621): Terminating (SIGTERM) 03:40:04.940005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Terminating (SIGTERM) 03:40:04.981546 --- ParallelTerminationStrategy: PID 21614 died... 03:40:05.001233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21614): Terminated: ok {rc=0} 03:40:05.047269 --- ParallelTerminationStrategy: PID 21621 died... 03:40:05.066574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21621): Terminated: ok {rc=0} 03:40:05.112836 --- ParallelTerminationStrategy: PID 21630 died... 03:40:05.132485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Terminated: ok {rc=0} 03:40:05.218801 bus /sierra_3: Setting Powered False 03:40:06.316141 bus /sierra_3: Setting Powered False 03:40:07.429574 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 03:40:08.514463 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:08.526193 tst emergency:sysmo: Using 1 x bts (candidates: 1) 03:40:08.564596 tst emergency_preemptive_call.py: using LAC 25732 03:40:08.681059 tst emergency_preemptive_call.py: using RAC 232 03:40:08.793987 tst emergency_preemptive_call.py: using CellId 25732 03:40:08.907545 tst emergency_preemptive_call.py: using BVCI 25733 03:40:09.011621 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:09.022204 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:09.032499 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:09.043073 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:09.053572 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:09.064035 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:09.174103 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:09.290189 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:09.402794 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:09.517472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:09.997780 run create_hlr_db(pid=21633): Launched 03:40:10.123487 bus /sierra_2: Setting Powered False 03:40:11.184863 run create_hlr_db(pid=21633): Terminated: ok {rc=0} 03:40:11.598014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21635): Launched 03:40:11.888178 run osmo-hlr_10.42.42.2(pid=21636): Launched 03:40:11.998186 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:12.496538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21638): Launched 03:40:12.800774 run osmo-stp_10.42.42.5(pid=21640): Launched 03:40:13.023197 tst emergency_preemptive_call.py: using MSISDN 7538 03:40:13.214807 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:13.796085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21761): Launched 03:40:14.121703 run osmo-msc_10.42.42.6(pid=21829): Launched 03:40:14.388776 run osmo-stp_10.42.42.5(pid=21640): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21640)] 03:40:14.569099 run osmo-stp_10.42.42.5(pid=21640): stdout: | (launched: 2022-12-10_03:40:12.735157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:14.733763 run osmo-stp_10.42.42.5(pid=21640): stderr: | 20221210034012966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034012966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034012967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034012967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034012967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034012968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034012968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:14.922175 run osmo-stp_10.42.42.5(pid=21640): stdout: | (launched: 2022-12-10_03:40:12.735157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:15.064588 run osmo-stp_10.42.42.5(pid=21640): stderr: | 20221210034012966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034012966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034012967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034012967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034012967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034012968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034012968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:15.218004 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21640): Process ended prematurely: osmo-stp_10.42.42.5(pid=21640) [trial-2369↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21640)] [trial-2369↪emergency:sysmo↪emergency_preemptive_call.py:32] 03:40:15.227036 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 03:40:15.254239 run osmo-hlr_10.42.42.2(pid=21636): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21636)] 03:40:15.304493 run osmo-hlr_10.42.42.2(pid=21636): stdout: | (launched: 2022-12-10_03:40:11.834999) 03:40:15.353476 run osmo-hlr_10.42.42.2(pid=21636): stderr: | 20221210034012008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034012008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034012008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034012008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034012008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034012008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034012020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034012029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034012029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034012029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:15.421484 run osmo-msc_10.42.42.6(pid=21829): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21829)] 03:40:15.468642 run osmo-msc_10.42.42.6(pid=21829): stdout: | (launched: 2022-12-10_03:40:14.060856) 03:40:15.517368 run osmo-msc_10.42.42.6(pid=21829): stderr: | 20221210034014650 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034014650 DLGLOBAL DEBUG validating counter group 0x7f794ff85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034014650 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034014650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034014651 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034014651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034014652 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034014661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034014661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034014661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:15.566626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21635): Terminating (SIGTERM) 03:40:15.606044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21638): Terminating (SIGTERM) 03:40:15.645732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21761): Terminating (SIGTERM) 03:40:15.686129 --- ParallelTerminationStrategy: PID 21635 died... 03:40:15.704767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21635): Terminated: ok {rc=0} 03:40:15.749295 --- ParallelTerminationStrategy: PID 21638 died... 03:40:15.767446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21638): Terminated: ok {rc=0} 03:40:15.812294 --- ParallelTerminationStrategy: PID 21761 died... 03:40:15.830916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21761): Terminated: ok {rc=0} 03:40:15.925684 bus /sierra_9: Setting Powered False 03:40:17.024067 bus /sierra_9: Setting Powered False 03:40:18.148421 bus /sierra_8: Setting Powered False 03:40:19.245463 bus /sierra_8: Setting Powered False 03:40:20.358273 bus /sierra_3: Setting Powered False 03:40:21.454432 bus /sierra_3: Setting Powered False 03:40:22.568831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:sysmo --------------------------------------------------------------------- 03:40:23.836158 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:40:23.841133 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 03:40:23.865384 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 03:40:23.907961 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 03:40:23.996084 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 03:40:24.021555 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 03:40:24.063279 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 03:40:24.644829 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 03:40:24.699056 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:24.710826 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:40:24.749173 tst cs_paging_gprs_active.py: using LAC 25733 03:40:24.867824 tst cs_paging_gprs_active.py: using RAC 233 03:40:24.986265 tst cs_paging_gprs_active.py: using CellId 25733 03:40:25.111334 tst cs_paging_gprs_active.py: using BVCI 25734 03:40:25.222467 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.233895 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.245505 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.258941 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.270270 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.283964 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.296300 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.310005 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:25.321686 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:25.439531 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:25.556181 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:40:25.761921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:26.079884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22173): Launched 03:40:26.365681 run iperf3-srv_10.42.42.10(pid=22174): Launched 03:40:26.487166 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:40:26.691043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:27.002113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22175): Launched 03:40:27.285761 run iperf3-srv_10.42.42.10(pid=22176): Launched 03:40:27.411112 tst cs_paging_gprs_active.py:38: start network... 03:40:27.614165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:28.091587 run create_hlr_db(pid=22177): Launched 03:40:28.249845 bus /sierra_2: Setting Powered False 03:40:29.308937 run create_hlr_db(pid=22177): Terminated: ok {rc=0} 03:40:29.720940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22180): Launched 03:40:30.015544 run osmo-hlr_10.42.42.2(pid=22181): Launched 03:40:30.127795 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:30.669238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22183): Launched 03:40:31.002804 run osmo-stp_10.42.42.5(pid=22184): Launched 03:40:31.243571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:40:32.857574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22186): Launched 03:40:32.977749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:40:33.243851 run patchelf(pid=22187): Launched 03:40:33.420694 run osmo-stp_10.42.42.5(pid=22184): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22184)] 03:40:33.553802 run osmo-stp_10.42.42.5(pid=22184): stdout: | (launched: 2022-12-10_03:40:30.941285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:33.689282 run osmo-stp_10.42.42.5(pid=22184): stderr: | 20221210034031228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034031228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034031228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034031233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034031234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034031234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034031234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:33.825328 run osmo-stp_10.42.42.5(pid=22184): stdout: | (launched: 2022-12-10_03:40:30.941285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:33.954575 run osmo-stp_10.42.42.5(pid=22184): stderr: | 20221210034031228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034031228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034031228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034031233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034031234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034031234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034031234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:34.107517 run patchelf(pid=22187): Terminating (SIGINT) 03:40:34.284453 run patchelf(pid=22187): Terminated: ok {rc=0} 03:40:34.412107 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22184): Process ended prematurely: osmo-stp_10.42.42.5(pid=22184) [trial-2369↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22184)] [trial-2369↪gprs:sysmo↪cs_paging_gprs_active.py:38] 03:40:34.422274 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 03:40:34.450682 run osmo-hlr_10.42.42.2(pid=22181): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22181)] 03:40:34.499759 run osmo-hlr_10.42.42.2(pid=22181): stdout: | (launched: 2022-12-10_03:40:29.961444) 03:40:34.550669 run osmo-hlr_10.42.42.2(pid=22181): stderr: | 20221210034030139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034030139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034030139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034030139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034030139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034030139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034030152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034030160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034030161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034030161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:34.602097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22173): Terminating (SIGTERM) 03:40:34.643228 run iperf3-srv_10.42.42.10(pid=22174): Terminating (SIGTERM) 03:40:34.684293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22175): Terminating (SIGTERM) 03:40:34.725784 run iperf3-srv_10.42.42.10(pid=22176): Terminating (SIGTERM) 03:40:34.766683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22180): Terminating (SIGTERM) 03:40:34.808098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22183): Terminating (SIGTERM) 03:40:34.849220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22186): Terminating (SIGTERM) 03:40:34.890373 --- ParallelTerminationStrategy: PID 22173 died... 03:40:34.909946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22173): Terminated: ok {rc=0} 03:40:34.955611 --- ParallelTerminationStrategy: PID 22174 died... 03:40:34.974838 run iperf3-srv_10.42.42.10(pid=22174): Terminated {rc=256} 03:40:35.020629 --- ParallelTerminationStrategy: PID 22175 died... 03:40:35.039962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22175): Terminated: ok {rc=0} 03:40:35.085595 --- ParallelTerminationStrategy: PID 22176 died... 03:40:35.104739 run iperf3-srv_10.42.42.10(pid=22176): Terminated {rc=256} 03:40:35.150254 --- ParallelTerminationStrategy: PID 22180 died... 03:40:35.173815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22180): Terminated: ok {rc=0} 03:40:35.219695 --- ParallelTerminationStrategy: PID 22183 died... 03:40:35.239185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22183): Terminated: ok {rc=0} 03:40:35.285133 --- ParallelTerminationStrategy: PID 22186 died... 03:40:35.304408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22186): Terminated: ok {rc=0} 03:40:35.390708 bus /gobi_0: Setting Powered False 03:40:36.488634 bus /gobi_0: Setting Powered False 03:40:37.602349 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo iperf3.py ---------------------------------------------- 03:40:38.748659 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:38.760398 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:40:38.796937 tst iperf3.py: using LAC 25734 03:40:38.920277 tst iperf3.py: using RAC 234 03:40:39.045352 tst iperf3.py: using CellId 25734 03:40:39.174007 tst iperf3.py: using BVCI 25735 03:40:39.289793 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.300665 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.311682 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.322486 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.333157 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.343916 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.354839 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.365643 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:39.376511 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:39.488796 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:40:39.688312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:39.984496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22188): Launched 03:40:40.240709 run iperf3-srv_10.42.42.10(pid=22189): Launched 03:40:40.350705 tst iperf3.py:8: start network... 03:40:40.547885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:41.002753 run create_hlr_db(pid=22190): Launched 03:40:41.116431 bus /gobi_6: Setting Powered False 03:40:42.175533 run create_hlr_db(pid=22190): Terminated: ok {rc=0} 03:40:42.605702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22192): Launched 03:40:42.920517 run osmo-hlr_10.42.42.2(pid=22193): Launched 03:40:43.040321 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:43.582301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22195): Launched 03:40:43.895996 run osmo-stp_10.42.42.5(pid=22196): Launched 03:40:44.015412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:40:44.556240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22198): Launched 03:40:44.676289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:40:44.941995 run patchelf(pid=22199): Launched 03:40:45.115867 run osmo-stp_10.42.42.5(pid=22196): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22196)] 03:40:45.249545 run osmo-stp_10.42.42.5(pid=22196): stdout: | (launched: 2022-12-10_03:40:43.837925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:45.384862 run osmo-stp_10.42.42.5(pid=22196): stderr: | 20221210034044029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034044029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034044029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034044030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034044030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034044030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034044030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:45.519756 run osmo-stp_10.42.42.5(pid=22196): stdout: | (launched: 2022-12-10_03:40:43.837925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:45.648650 run osmo-stp_10.42.42.5(pid=22196): stderr: | 20221210034044029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034044029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034044029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034044030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034044030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034044030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034044030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:45.801907 run patchelf(pid=22199): Terminating (SIGINT) 03:40:45.996805 run patchelf(pid=22199): Terminated: ok {rc=0} 03:40:46.128932 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22196): Process ended prematurely: osmo-stp_10.42.42.5(pid=22196) [trial-2369↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22196)] [trial-2369↪gprs:sysmo↪iperf3.py:8] 03:40:46.139833 tst iperf3.py:8: Test FAILED (7.4 sec) 03:40:46.170534 run osmo-hlr_10.42.42.2(pid=22193): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22193)] 03:40:46.220426 run osmo-hlr_10.42.42.2(pid=22193): stdout: | (launched: 2022-12-10_03:40:42.863248) 03:40:46.272183 run osmo-hlr_10.42.42.2(pid=22193): stderr: | 20221210034043059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034043059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034043059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034043059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034043060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034043060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034043071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034043080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034043080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034043080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:46.326372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22188): Terminating (SIGTERM) 03:40:46.369238 run iperf3-srv_10.42.42.10(pid=22189): Terminating (SIGTERM) 03:40:46.413119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22192): Terminating (SIGTERM) 03:40:46.456211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22195): Terminating (SIGTERM) 03:40:46.501112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22198): Terminating (SIGTERM) 03:40:46.546054 --- ParallelTerminationStrategy: PID 22188 died... 03:40:46.566172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22188): Terminated: ok {rc=0} 03:40:46.615724 --- ParallelTerminationStrategy: PID 22189 died... 03:40:46.635335 run iperf3-srv_10.42.42.10(pid=22189): Terminated {rc=256} 03:40:46.683263 --- ParallelTerminationStrategy: PID 22192 died... 03:40:46.703794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22192): Terminated: ok {rc=0} 03:40:46.752354 --- ParallelTerminationStrategy: PID 22195 died... 03:40:46.772089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22195): Terminated: ok {rc=0} 03:40:46.819730 --- ParallelTerminationStrategy: PID 22198 died... 03:40:46.839416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22198): Terminated: ok {rc=0} 03:40:46.927552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo iperf3m4.py ---------------------------------------------- 03:40:48.078612 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.090431 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:40:48.124791 tst iperf3m4.py: using LAC 25735 03:40:48.247336 tst iperf3m4.py: using RAC 235 03:40:48.371007 tst iperf3m4.py: using CellId 25735 03:40:48.498424 tst iperf3m4.py: using BVCI 25736 03:40:48.613459 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.624430 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.635338 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.646162 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.656709 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.667395 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.678314 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.689063 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:48.700257 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:48.817834 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:48.935108 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:49.049039 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:49.165578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:40:49.364071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:49.660900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22200): Launched 03:40:49.918374 run iperf3-srv_10.42.42.10(pid=22201): Launched 03:40:50.030422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:40:50.229257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:50.525928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22202): Launched 03:40:50.782903 run iperf3-srv_10.42.42.10(pid=22203): Launched 03:40:50.893266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:40:51.090840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:51.386843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22204): Launched 03:40:51.642975 run iperf3-srv_10.42.42.10(pid=22205): Launched 03:40:51.752936 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:40:51.950551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:52.245629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22206): Launched 03:40:52.516346 run iperf3-srv_10.42.42.10(pid=22207): Launched 03:40:52.626290 tst iperf3m4.py:8: start network... 03:40:52.823929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:53.279048 run create_hlr_db(pid=22208): Launched 03:40:53.391236 bus /gobi_6: Setting Powered False 03:40:54.450376 run create_hlr_db(pid=22208): Terminated: ok {rc=0} 03:40:54.860851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22210): Launched 03:40:55.154388 run osmo-hlr_10.42.42.2(pid=22211): Launched 03:40:55.266791 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:55.792027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22213): Launched 03:40:56.085232 run osmo-stp_10.42.42.5(pid=22214): Launched 03:40:56.197354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:40:56.702934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22216): Launched 03:40:56.815348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:40:57.063819 run patchelf(pid=22217): Launched 03:40:57.227303 run osmo-stp_10.42.42.5(pid=22214): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22214)] 03:40:57.352421 run osmo-stp_10.42.42.5(pid=22214): stdout: | (launched: 2022-12-10_03:40:56.031199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:57.479147 run osmo-stp_10.42.42.5(pid=22214): stderr: | 20221210034056199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034056199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034056200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034056200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034056201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034056201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034056201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:57.606049 run osmo-stp_10.42.42.5(pid=22214): stdout: | (launched: 2022-12-10_03:40:56.031199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:57.726851 run osmo-stp_10.42.42.5(pid=22214): stderr: | 20221210034056199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034056199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034056200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034056200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034056201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034056201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034056201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:57.870093 run patchelf(pid=22217): Terminating (SIGINT) 03:40:58.035951 run patchelf(pid=22217): Terminated: ok {rc=0} 03:40:58.155347 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22214): Process ended prematurely: osmo-stp_10.42.42.5(pid=22214) [trial-2369↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22214)] [trial-2369↪gprs:sysmo↪iperf3m4.py:8] 03:40:58.164829 tst iperf3m4.py:8: Test FAILED (10.1 sec) 03:40:58.192518 run osmo-hlr_10.42.42.2(pid=22211): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22211)] 03:40:58.239643 run osmo-hlr_10.42.42.2(pid=22211): stdout: | (launched: 2022-12-10_03:40:55.100495) 03:40:58.288304 run osmo-hlr_10.42.42.2(pid=22211): stderr: | 20221210034055275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034055275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034055275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034055275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034055275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034055275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034055287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034055297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034055297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034055297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:58.337444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22200): Terminating (SIGTERM) 03:40:58.376358 run iperf3-srv_10.42.42.10(pid=22201): Terminating (SIGTERM) 03:40:58.415204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22202): Terminating (SIGTERM) 03:40:58.454207 run iperf3-srv_10.42.42.10(pid=22203): Terminating (SIGTERM) 03:40:58.493069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22204): Terminating (SIGTERM) 03:40:58.531671 run iperf3-srv_10.42.42.10(pid=22205): Terminating (SIGTERM) 03:40:58.570846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22206): Terminating (SIGTERM) 03:40:58.609874 run iperf3-srv_10.42.42.10(pid=22207): Terminating (SIGTERM) 03:40:58.648815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22210): Terminating (SIGTERM) 03:40:58.688070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22213): Terminating (SIGTERM) 03:40:58.727059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22216): Terminating (SIGTERM) 03:40:58.766310 --- ParallelTerminationStrategy: PID 22200 died... 03:40:58.784876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22200): Terminated: ok {rc=0} 03:40:58.828463 --- ParallelTerminationStrategy: PID 22201 died... 03:40:58.846548 run iperf3-srv_10.42.42.10(pid=22201): Terminated {rc=256} 03:40:58.889956 --- ParallelTerminationStrategy: PID 22202 died... 03:40:58.908120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22202): Terminated: ok {rc=0} 03:40:58.951473 --- ParallelTerminationStrategy: PID 22203 died... 03:40:58.969641 run iperf3-srv_10.42.42.10(pid=22203): Terminated {rc=256} 03:40:59.013179 --- ParallelTerminationStrategy: PID 22204 died... 03:40:59.031280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22204): Terminated: ok {rc=0} 03:40:59.074650 --- ParallelTerminationStrategy: PID 22205 died... 03:40:59.092739 run iperf3-srv_10.42.42.10(pid=22205): Terminated {rc=256} 03:40:59.135903 --- ParallelTerminationStrategy: PID 22206 died... 03:40:59.154027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22206): Terminated: ok {rc=0} 03:40:59.197696 --- ParallelTerminationStrategy: PID 22207 died... 03:40:59.215882 run iperf3-srv_10.42.42.10(pid=22207): Terminated {rc=256} 03:40:59.259728 --- ParallelTerminationStrategy: PID 22210 died... 03:40:59.277978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22210): Terminated: ok {rc=0} 03:40:59.321486 --- ParallelTerminationStrategy: PID 22213 died... 03:40:59.339784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22213): Terminated: ok {rc=0} 03:40:59.383313 --- ParallelTerminationStrategy: PID 22216 died... 03:40:59.401601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22216): Terminated: ok {rc=0} 03:40:59.486635 bus /gobi_4: Setting Powered False 03:41:00.586139 bus /gobi_4: Setting Powered False 03:41:01.699085 bus /gobi_1: Setting Powered False 03:41:02.796715 bus /gobi_1: Setting Powered False 03:41:03.910809 bus /gobi_0: Setting Powered False 03:41:05.007824 bus /gobi_0: Setting Powered False 03:41:06.125363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo ping.py ---------------------------------------------- 03:41:07.227357 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.238381 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:07.274523 tst ping.py: using LAC 25736 03:41:07.388809 tst ping.py: using RAC 236 03:41:07.503521 tst ping.py: using CellId 25736 03:41:07.621347 tst ping.py: using BVCI 25737 03:41:07.727262 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.737812 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.748289 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.758925 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.769450 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.779929 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.790646 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:07.801346 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:07.913477 tst ping.py:19: start network... 03:41:08.107320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:08.555482 run create_hlr_db(pid=22218): Launched 03:41:08.664346 bus /gobi_6: Setting Powered False 03:41:09.723403 run create_hlr_db(pid=22218): Terminated: ok {rc=0} 03:41:10.147157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22220): Launched 03:41:10.456086 run osmo-hlr_10.42.42.2(pid=22221): Launched 03:41:10.574800 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:11.109145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22223): Launched 03:41:11.417079 run osmo-stp_10.42.42.5(pid=22224): Launched 03:41:11.534625 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:12.068136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22226): Launched 03:41:12.186485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:12.447099 run patchelf(pid=22227): Launched 03:41:12.618627 run osmo-stp_10.42.42.5(pid=22224): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22224)] 03:41:12.749915 run osmo-stp_10.42.42.5(pid=22224): stdout: | (launched: 2022-12-10_03:41:11.360609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:12.883157 run osmo-stp_10.42.42.5(pid=22224): stderr: | 20221210034111551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034111551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034111551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034111551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034111552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034111552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034111552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:13.015976 run osmo-stp_10.42.42.5(pid=22224): stdout: | (launched: 2022-12-10_03:41:11.360609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:13.142850 run osmo-stp_10.42.42.5(pid=22224): stderr: | 20221210034111551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034111551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034111551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034111551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034111552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034111552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034111552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:13.293145 run patchelf(pid=22227): Terminating (SIGINT) 03:41:13.466468 run patchelf(pid=22227): Terminated: ok {rc=0} 03:41:13.591370 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22224): Process ended prematurely: osmo-stp_10.42.42.5(pid=22224) [trial-2369↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22224)] [trial-2369↪gprs:sysmo↪ping.py:22] 03:41:13.600736 tst ping.py:22: Test FAILED (6.4 sec) 03:41:13.628441 run osmo-hlr_10.42.42.2(pid=22221): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22221)] 03:41:13.677805 run osmo-hlr_10.42.42.2(pid=22221): stdout: | (launched: 2022-12-10_03:41:10.399773) 03:41:13.728753 run osmo-hlr_10.42.42.2(pid=22221): stderr: | 20221210034110598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034110598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034110598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034110598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034110598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034110598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034110611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034110622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034110622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034110622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:13.780279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22220): Terminating (SIGTERM) 03:41:13.821919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22223): Terminating (SIGTERM) 03:41:13.863330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22226): Terminating (SIGTERM) 03:41:13.904805 --- ParallelTerminationStrategy: PID 22220 died... 03:41:13.924685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22220): Terminated: ok {rc=0} 03:41:13.970541 --- ParallelTerminationStrategy: PID 22223 died... 03:41:13.989998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22223): Terminated: ok {rc=0} 03:41:14.035763 --- ParallelTerminationStrategy: PID 22226 died... 03:41:14.055046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22226): Terminated: ok {rc=0} 03:41:14.141964 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 03:41:15.228355 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.240219 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:15.278122 tst ping_idle_ping.py: using LAC 25737 03:41:15.401400 tst ping_idle_ping.py: using RAC 237 03:41:15.522818 tst ping_idle_ping.py: using CellId 25737 03:41:15.647473 tst ping_idle_ping.py: using BVCI 25738 03:41:15.761250 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.772068 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.782969 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.794103 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.804807 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.815549 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.826414 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:15.845959 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:16.006081 tst ping_idle_ping.py:24: start network... 03:41:16.212408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:16.690942 run create_hlr_db(pid=22228): Launched 03:41:16.837635 bus /gobi_6: Setting Powered False 03:41:17.899288 run create_hlr_db(pid=22228): Terminated: ok {rc=0} 03:41:18.313657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22230): Launched 03:41:18.603502 run osmo-hlr_10.42.42.2(pid=22231): Launched 03:41:18.714209 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:19.210588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22233): Launched 03:41:19.499007 run osmo-stp_10.42.42.5(pid=22234): Launched 03:41:19.609133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:20.110212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22236): Launched 03:41:20.221809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:20.467426 run patchelf(pid=22237): Launched 03:41:20.629176 run osmo-stp_10.42.42.5(pid=22234): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22234)] 03:41:20.752471 run osmo-stp_10.42.42.5(pid=22234): stdout: | (launched: 2022-12-10_03:41:19.445759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:20.877390 run osmo-stp_10.42.42.5(pid=22234): stderr: | 20221210034119613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034119613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034119613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034119614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034119616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034119616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034119616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:21.002193 run osmo-stp_10.42.42.5(pid=22234): stdout: | (launched: 2022-12-10_03:41:19.445759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:21.121504 run osmo-stp_10.42.42.5(pid=22234): stderr: | 20221210034119613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034119613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034119613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034119614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034119616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034119616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034119616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:21.262332 run patchelf(pid=22237): Terminating (SIGINT) 03:41:21.425225 run patchelf(pid=22237): Terminated: ok {rc=0} 03:41:21.543049 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22234): Process ended prematurely: osmo-stp_10.42.42.5(pid=22234) [trial-2369↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22234)] [trial-2369↪gprs:sysmo↪ping_idle_ping.py:27] 03:41:21.551820 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 03:41:21.578735 run osmo-hlr_10.42.42.2(pid=22231): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22231)] 03:41:21.625858 run osmo-hlr_10.42.42.2(pid=22231): stdout: | (launched: 2022-12-10_03:41:18.549914) 03:41:21.674631 run osmo-hlr_10.42.42.2(pid=22231): stderr: | 20221210034118727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034118727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034118727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034118727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034118727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034118727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034118757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034118768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034118768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034118768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:21.723679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22230): Terminating (SIGTERM) 03:41:21.762994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22233): Terminating (SIGTERM) 03:41:21.802424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22236): Terminating (SIGTERM) 03:41:21.842081 --- ParallelTerminationStrategy: PID 22230 died... 03:41:21.860812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22230): Terminated: ok {rc=0} 03:41:21.904873 --- ParallelTerminationStrategy: PID 22233 died... 03:41:21.923434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22233): Terminated: ok {rc=0} 03:41:21.967735 --- ParallelTerminationStrategy: PID 22236 died... 03:41:21.986121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22236): Terminated: ok {rc=0} 03:41:22.071251 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 03:41:23.350863 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:41:23.356310 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:41:23.377814 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:41:23.416631 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:41:23.502796 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:41:23.523127 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:41:23.561518 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:41:24.156067 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:41:24.204394 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.215218 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:41:24.250699 tst cs_paging_gprs_active.py: using LAC 25738 03:41:24.369457 tst cs_paging_gprs_active.py: using RAC 238 03:41:24.485645 tst cs_paging_gprs_active.py: using CellId 25738 03:41:24.609783 tst cs_paging_gprs_active.py: using BVCI 25739 03:41:24.726990 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.738203 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.749177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.760699 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.772127 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.783420 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.794955 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.806719 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:24.818395 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:24.934365 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:25.048100 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:41:25.246916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:25.544079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22241): Launched 03:41:25.802088 run iperf3-srv_10.42.42.10(pid=22242): Launched 03:41:25.912687 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:41:26.110620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:26.407334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22243): Launched 03:41:26.664237 run iperf3-srv_10.42.42.10(pid=22244): Launched 03:41:26.774923 tst cs_paging_gprs_active.py:38: start network... 03:41:26.973411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:27.429839 run create_hlr_db(pid=22245): Launched 03:41:27.543520 bus /gobi_6: Setting Powered False 03:41:28.602279 run create_hlr_db(pid=22245): Terminated: ok {rc=0} 03:41:29.033900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22247): Launched 03:41:29.348783 run osmo-hlr_10.42.42.2(pid=22248): Launched 03:41:29.468703 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:30.012599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22250): Launched 03:41:30.328131 run osmo-stp_10.42.42.5(pid=22251): Launched 03:41:30.448358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:31.026354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22253): Launched 03:41:31.155261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:31.443523 run patchelf(pid=22254): Launched 03:41:31.627023 run osmo-stp_10.42.42.5(pid=22251): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22251)] 03:41:31.763047 run osmo-stp_10.42.42.5(pid=22251): stdout: | (launched: 2022-12-10_03:41:30.270389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:31.902285 run osmo-stp_10.42.42.5(pid=22251): stderr: | 20221210034130462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034130462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034130463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034130463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034130463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034130464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034130464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:32.041269 run osmo-stp_10.42.42.5(pid=22251): stdout: | (launched: 2022-12-10_03:41:30.270389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:32.172693 run osmo-stp_10.42.42.5(pid=22251): stderr: | 20221210034130462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034130462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034130463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034130463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034130463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034130464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034130464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:32.326837 run patchelf(pid=22254): Terminating (SIGINT) 03:41:32.504001 run patchelf(pid=22254): Terminated: ok {rc=0} 03:41:32.631978 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22251): Process ended prematurely: osmo-stp_10.42.42.5(pid=22251) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22251)] [trial-2369↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:41:32.642563 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 03:41:32.671036 run osmo-hlr_10.42.42.2(pid=22248): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22248)] 03:41:32.720629 run osmo-hlr_10.42.42.2(pid=22248): stdout: | (launched: 2022-12-10_03:41:29.290934) 03:41:32.771832 run osmo-hlr_10.42.42.2(pid=22248): stderr: | 20221210034129489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034129489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034129489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034129489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034129489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034129489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034129527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034129536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034129536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034129537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:32.823909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22241): Terminating (SIGTERM) 03:41:32.865660 run iperf3-srv_10.42.42.10(pid=22242): Terminating (SIGTERM) 03:41:32.907052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22243): Terminating (SIGTERM) 03:41:32.948484 run iperf3-srv_10.42.42.10(pid=22244): Terminating (SIGTERM) 03:41:32.989905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22247): Terminating (SIGTERM) 03:41:33.031477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22250): Terminating (SIGTERM) 03:41:33.073067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22253): Terminating (SIGTERM) 03:41:33.114791 --- ParallelTerminationStrategy: PID 22241 died... 03:41:33.134684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22241): Terminated: ok {rc=0} 03:41:33.180687 --- ParallelTerminationStrategy: PID 22242 died... 03:41:33.200122 run iperf3-srv_10.42.42.10(pid=22242): Terminated {rc=256} 03:41:33.246228 --- ParallelTerminationStrategy: PID 22243 died... 03:41:33.265830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22243): Terminated: ok {rc=0} 03:41:33.311310 --- ParallelTerminationStrategy: PID 22244 died... 03:41:33.330710 run iperf3-srv_10.42.42.10(pid=22244): Terminated {rc=256} 03:41:33.376113 --- ParallelTerminationStrategy: PID 22247 died... 03:41:33.395486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22247): Terminated: ok {rc=0} 03:41:33.441591 --- ParallelTerminationStrategy: PID 22250 died... 03:41:33.460855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22250): Terminated: ok {rc=0} 03:41:33.506981 --- ParallelTerminationStrategy: PID 22253 died... 03:41:33.526431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22253): Terminated: ok {rc=0} 03:41:33.613593 bus /gobi_0: Setting Powered False 03:41:34.709730 bus /gobi_0: Setting Powered False 03:41:35.822641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:41:36.966737 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:36.978047 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:41:37.019591 tst iperf3.py: using LAC 25739 03:41:37.135021 tst iperf3.py: using RAC 239 03:41:37.248513 tst iperf3.py: using CellId 25739 03:41:37.362949 tst iperf3.py: using BVCI 25740 03:41:37.469195 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.479803 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.490381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.501161 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.511826 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.522530 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.533389 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.543979 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:37.554790 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:37.674033 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:41:37.888076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:38.203075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22257): Launched 03:41:38.477154 run iperf3-srv_10.42.42.10(pid=22258): Launched 03:41:38.594756 tst iperf3.py:8: start network... 03:41:38.807208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:39.294434 run create_hlr_db(pid=22259): Launched 03:41:39.422392 bus /gobi_6: Setting Powered False 03:41:40.484809 run create_hlr_db(pid=22259): Terminated: ok {rc=0} 03:41:40.904399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22261): Launched 03:41:41.198075 run osmo-hlr_10.42.42.2(pid=22262): Launched 03:41:41.310018 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:41.826020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22264): Launched 03:41:42.120293 run osmo-stp_10.42.42.5(pid=22265): Launched 03:41:42.232541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:42.741387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22267): Launched 03:41:42.854699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:43.103022 run patchelf(pid=22268): Launched 03:41:43.266649 run osmo-stp_10.42.42.5(pid=22265): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22265)] 03:41:43.391793 run osmo-stp_10.42.42.5(pid=22265): stdout: | (launched: 2022-12-10_03:41:42.066147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:43.518878 run osmo-stp_10.42.42.5(pid=22265): stderr: | 20221210034142235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034142235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034142235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034142236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034142236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034142236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034142237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:43.645915 run osmo-stp_10.42.42.5(pid=22265): stdout: | (launched: 2022-12-10_03:41:42.066147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:43.767079 run osmo-stp_10.42.42.5(pid=22265): stderr: | 20221210034142235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034142235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034142235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034142236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034142236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034142236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034142237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:43.910419 run patchelf(pid=22268): Terminating (SIGINT) 03:41:44.076445 run patchelf(pid=22268): Terminated: ok {rc=0} 03:41:44.196784 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22265): Process ended prematurely: osmo-stp_10.42.42.5(pid=22265) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22265)] [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 03:41:44.206395 tst iperf3.py:8: Test FAILED (7.3 sec) 03:41:44.233581 run osmo-hlr_10.42.42.2(pid=22262): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22262)] 03:41:44.281118 run osmo-hlr_10.42.42.2(pid=22262): stdout: | (launched: 2022-12-10_03:41:41.144263) 03:41:44.329821 run osmo-hlr_10.42.42.2(pid=22262): stderr: | 20221210034141321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034141321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034141321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034141321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034141321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034141321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034141334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034141342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034141342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034141343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:44.379426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22257): Terminating (SIGTERM) 03:41:44.418889 run iperf3-srv_10.42.42.10(pid=22258): Terminating (SIGTERM) 03:41:44.459401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22261): Terminating (SIGTERM) 03:41:44.499262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22264): Terminating (SIGTERM) 03:41:44.538592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22267): Terminating (SIGTERM) 03:41:44.578005 --- ParallelTerminationStrategy: PID 22257 died... 03:41:44.596861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22257): Terminated: ok {rc=0} 03:41:44.640532 --- ParallelTerminationStrategy: PID 22258 died... 03:41:44.658816 run iperf3-srv_10.42.42.10(pid=22258): Terminated {rc=256} 03:41:44.702195 --- ParallelTerminationStrategy: PID 22261 died... 03:41:44.720412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22261): Terminated: ok {rc=0} 03:41:44.763783 --- ParallelTerminationStrategy: PID 22264 died... 03:41:44.782129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22264): Terminated: ok {rc=0} 03:41:44.825706 --- ParallelTerminationStrategy: PID 22267 died... 03:41:44.843910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22267): Terminated: ok {rc=0} 03:41:44.929106 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:41:46.103856 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.120295 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:41:46.169042 tst iperf3m4.py: using LAC 25740 03:41:46.288242 tst iperf3m4.py: using RAC 240 03:41:46.415639 tst iperf3m4.py: using CellId 25740 03:41:46.567397 tst iperf3m4.py: using BVCI 25741 03:41:46.703985 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.715907 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.728212 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.740528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.752715 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.764997 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.776712 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.788864 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:46.801255 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:46.917355 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:47.062840 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:47.186611 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:47.306529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:41:47.506277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:47.804601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Launched 03:41:48.062259 run iperf3-srv_10.42.42.10(pid=22270): Launched 03:41:48.172467 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:41:48.370953 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:48.668025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22271): Launched 03:41:48.925907 run iperf3-srv_10.42.42.10(pid=22272): Launched 03:41:49.036056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:41:49.233714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:49.530086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22273): Launched 03:41:49.786644 run iperf3-srv_10.42.42.10(pid=22274): Launched 03:41:49.896439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:41:50.093846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:50.389981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22275): Launched 03:41:50.646948 run iperf3-srv_10.42.42.10(pid=22276): Launched 03:41:50.757104 tst iperf3m4.py:8: start network... 03:41:50.954111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:51.409436 run create_hlr_db(pid=22277): Launched 03:41:51.522459 bus /gobi_6: Setting Powered False 03:41:52.581921 run create_hlr_db(pid=22277): Terminated: ok {rc=0} 03:41:52.992861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22279): Launched 03:41:53.287190 run osmo-hlr_10.42.42.2(pid=22280): Launched 03:41:53.399111 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:53.903033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22282): Launched 03:41:54.197330 run osmo-stp_10.42.42.5(pid=22283): Launched 03:41:54.308875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:54.816382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22285): Launched 03:41:54.929752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:55.178075 run patchelf(pid=22286): Launched 03:41:55.341215 run osmo-stp_10.42.42.5(pid=22283): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22283)] 03:41:55.465837 run osmo-stp_10.42.42.5(pid=22283): stdout: | (launched: 2022-12-10_03:41:54.142946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:55.591811 run osmo-stp_10.42.42.5(pid=22283): stderr: | 20221210034154314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034154314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034154314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034154315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034154315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034154315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034154315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:55.718471 run osmo-stp_10.42.42.5(pid=22283): stdout: | (launched: 2022-12-10_03:41:54.142946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:55.839030 run osmo-stp_10.42.42.5(pid=22283): stderr: | 20221210034154314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034154314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034154314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034154315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034154315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034154315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034154315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:55.981902 run patchelf(pid=22286): Terminating (SIGINT) 03:41:56.147002 run patchelf(pid=22286): Terminated: ok {rc=0} 03:41:56.266413 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22283): Process ended prematurely: osmo-stp_10.42.42.5(pid=22283) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22283)] [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 03:41:56.275946 tst iperf3m4.py:8: Test FAILED (10.2 sec) 03:41:56.303384 run osmo-hlr_10.42.42.2(pid=22280): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22280)] 03:41:56.350311 run osmo-hlr_10.42.42.2(pid=22280): stdout: | (launched: 2022-12-10_03:41:53.232786) 03:41:56.398644 run osmo-hlr_10.42.42.2(pid=22280): stderr: | 20221210034153409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034153409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034153409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034153409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034153409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034153409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034153421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034153430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034153430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034153430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:56.447557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Terminating (SIGTERM) 03:41:56.486781 run iperf3-srv_10.42.42.10(pid=22270): Terminating (SIGTERM) 03:41:56.525726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22271): Terminating (SIGTERM) 03:41:56.564409 run iperf3-srv_10.42.42.10(pid=22272): Terminating (SIGTERM) 03:41:56.603272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22273): Terminating (SIGTERM) 03:41:56.642134 run iperf3-srv_10.42.42.10(pid=22274): Terminating (SIGTERM) 03:41:56.681032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22275): Terminating (SIGTERM) 03:41:56.719854 run iperf3-srv_10.42.42.10(pid=22276): Terminating (SIGTERM) 03:41:56.758745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22279): Terminating (SIGTERM) 03:41:56.797868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22282): Terminating (SIGTERM) 03:41:56.837045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22285): Terminating (SIGTERM) 03:41:56.876336 --- ParallelTerminationStrategy: PID 22269 died... 03:41:56.895137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Terminated: ok {rc=0} 03:41:56.938865 --- ParallelTerminationStrategy: PID 22270 died... 03:41:56.957128 run iperf3-srv_10.42.42.10(pid=22270): Terminated {rc=256} 03:41:57.000403 --- ParallelTerminationStrategy: PID 22271 died... 03:41:57.018608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22271): Terminated: ok {rc=0} 03:41:57.062177 --- ParallelTerminationStrategy: PID 22272 died... 03:41:57.080528 run iperf3-srv_10.42.42.10(pid=22272): Terminated {rc=256} 03:41:57.124560 --- ParallelTerminationStrategy: PID 22273 died... 03:41:57.142734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22273): Terminated: ok {rc=0} 03:41:57.186189 --- ParallelTerminationStrategy: PID 22274 died... 03:41:57.204338 run iperf3-srv_10.42.42.10(pid=22274): Terminated {rc=256} 03:41:57.247676 --- ParallelTerminationStrategy: PID 22275 died... 03:41:57.265961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22275): Terminated: ok {rc=0} 03:41:57.309865 --- ParallelTerminationStrategy: PID 22276 died... 03:41:57.328256 run iperf3-srv_10.42.42.10(pid=22276): Terminated {rc=256} 03:41:57.371682 --- ParallelTerminationStrategy: PID 22279 died... 03:41:57.389959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22279): Terminated: ok {rc=0} 03:41:57.433708 --- ParallelTerminationStrategy: PID 22282 died... 03:41:57.452088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22282): Terminated: ok {rc=0} 03:41:57.495844 --- ParallelTerminationStrategy: PID 22285 died... 03:41:57.514153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22285): Terminated: ok {rc=0} 03:41:57.597243 bus /gobi_4: Setting Powered False 03:41:58.694332 bus /gobi_4: Setting Powered False 03:41:59.811590 bus /gobi_1: Setting Powered False 03:42:00.926174 bus /gobi_1: Setting Powered False 03:42:02.050579 bus /gobi_0: Setting Powered False 03:42:03.150747 bus /gobi_0: Setting Powered False 03:42:04.267094 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 03:42:05.369078 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.380935 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:05.419697 tst ping.py: using LAC 25741 03:42:05.542441 tst ping.py: using RAC 241 03:42:05.665264 tst ping.py: using CellId 25741 03:42:05.781880 tst ping.py: using BVCI 25742 03:42:05.888398 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.899203 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.909903 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.921182 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.932244 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.943412 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.954835 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:05.966101 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:06.081147 tst ping.py:19: start network... 03:42:06.275782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:06.725076 run create_hlr_db(pid=22290): Launched 03:42:06.834822 bus /gobi_6: Setting Powered False 03:42:07.893557 run create_hlr_db(pid=22290): Terminated: ok {rc=0} 03:42:08.318087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22292): Launched 03:42:08.628244 run osmo-hlr_10.42.42.2(pid=22293): Launched 03:42:08.747841 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:09.280674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22295): Launched 03:42:09.588730 run osmo-stp_10.42.42.5(pid=22296): Launched 03:42:09.706741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:10.241099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22298): Launched 03:42:10.358427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:10.619917 run patchelf(pid=22299): Launched 03:42:10.791690 run osmo-stp_10.42.42.5(pid=22296): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22296)] 03:42:10.923375 run osmo-stp_10.42.42.5(pid=22296): stdout: | (launched: 2022-12-10_03:42:09.532292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:11.055856 run osmo-stp_10.42.42.5(pid=22296): stderr: | 20221210034209723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034209723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034209723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034209724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034209724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034209724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034209724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:11.188180 run osmo-stp_10.42.42.5(pid=22296): stdout: | (launched: 2022-12-10_03:42:09.532292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:11.314811 run osmo-stp_10.42.42.5(pid=22296): stderr: | 20221210034209723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034209723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034209723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034209724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034209724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034209724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034209724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:11.465056 run patchelf(pid=22299): Terminating (SIGINT) 03:42:11.638074 run patchelf(pid=22299): Terminated: ok {rc=0} 03:42:11.763323 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22296): Process ended prematurely: osmo-stp_10.42.42.5(pid=22296) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22296)] [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 03:42:11.772784 tst ping.py:22: Test FAILED (6.4 sec) 03:42:11.800518 run osmo-hlr_10.42.42.2(pid=22293): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22293)] 03:42:11.850478 run osmo-hlr_10.42.42.2(pid=22293): stdout: | (launched: 2022-12-10_03:42:08.571317) 03:42:11.901848 run osmo-hlr_10.42.42.2(pid=22293): stderr: | 20221210034208767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034208767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034208767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034208767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034208767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034208767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034208780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034208788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034208789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034208789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:11.953384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22292): Terminating (SIGTERM) 03:42:11.994577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22295): Terminating (SIGTERM) 03:42:12.035853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22298): Terminating (SIGTERM) 03:42:12.077371 --- ParallelTerminationStrategy: PID 22292 died... 03:42:12.096881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22292): Terminated: ok {rc=0} 03:42:12.142853 --- ParallelTerminationStrategy: PID 22295 died... 03:42:12.162239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22295): Terminated: ok {rc=0} 03:42:12.208042 --- ParallelTerminationStrategy: PID 22298 died... 03:42:12.227534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22298): Terminated: ok {rc=0} 03:42:12.314307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:42:13.400188 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.412052 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:13.450488 tst ping_idle_ping.py: using LAC 25742 03:42:13.566487 tst ping_idle_ping.py: using RAC 242 03:42:13.680347 tst ping_idle_ping.py: using CellId 25742 03:42:13.794366 tst ping_idle_ping.py: using BVCI 25743 03:42:13.899514 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.910232 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.920681 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.931551 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.942353 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.953084 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.963859 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:13.974591 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:14.097812 tst ping_idle_ping.py:24: start network... 03:42:14.306899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:14.788452 run create_hlr_db(pid=22300): Launched 03:42:14.914302 bus /gobi_6: Setting Powered False 03:42:15.975126 run create_hlr_db(pid=22300): Terminated: ok {rc=0} 03:42:16.420343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22302): Launched 03:42:16.745774 run osmo-hlr_10.42.42.2(pid=22303): Launched 03:42:16.928071 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:17.535232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22305): Launched 03:42:17.845463 run osmo-stp_10.42.42.5(pid=22306): Launched 03:42:17.962976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:18.498716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22308): Launched 03:42:18.616999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:18.879581 run patchelf(pid=22309): Launched 03:42:19.051761 run osmo-stp_10.42.42.5(pid=22306): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22306)] 03:42:19.183424 run osmo-stp_10.42.42.5(pid=22306): stdout: | (launched: 2022-12-10_03:42:17.788363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:19.316232 run osmo-stp_10.42.42.5(pid=22306): stderr: | 20221210034217978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034217978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034217979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034217979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034217981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034217981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034217981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:19.449184 run osmo-stp_10.42.42.5(pid=22306): stdout: | (launched: 2022-12-10_03:42:17.788363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:19.576251 run osmo-stp_10.42.42.5(pid=22306): stderr: | 20221210034217978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034217978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034217979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034217979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034217981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034217981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034217981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:19.726834 run patchelf(pid=22309): Terminating (SIGINT) 03:42:19.901109 run patchelf(pid=22309): Terminated: ok {rc=0} 03:42:20.026106 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22306): Process ended prematurely: osmo-stp_10.42.42.5(pid=22306) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22306)] [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 03:42:20.035782 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:42:20.063364 run osmo-hlr_10.42.42.2(pid=22303): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22303)] 03:42:20.112776 run osmo-hlr_10.42.42.2(pid=22303): stdout: | (launched: 2022-12-10_03:42:16.683496) 03:42:20.163853 run osmo-hlr_10.42.42.2(pid=22303): stderr: | 20221210034217012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034217012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034217012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034217012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034217012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034217012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034217032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034217040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034217049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034217049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:20.215059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22302): Terminating (SIGTERM) 03:42:20.256483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22305): Terminating (SIGTERM) 03:42:20.297982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22308): Terminating (SIGTERM) 03:42:20.339706 --- ParallelTerminationStrategy: PID 22302 died... 03:42:20.359642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22302): Terminated: ok {rc=0} 03:42:20.405535 --- ParallelTerminationStrategy: PID 22305 died... 03:42:20.424920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22305): Terminated: ok {rc=0} 03:42:20.470691 --- ParallelTerminationStrategy: PID 22308 died... 03:42:20.490133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22308): Terminated: ok {rc=0} 03:42:20.576426 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:42:21.873948 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:42:21.880433 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:42:21.901865 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:42:21.941372 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:42:22.032251 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:42:22.054477 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:42:22.093615 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:42:22.685164 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:42:22.736058 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:22.747427 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:42:22.808770 tst cs_paging_gprs_active.py: using LAC 25743 03:42:22.932297 tst cs_paging_gprs_active.py: using RAC 243 03:42:23.054632 tst cs_paging_gprs_active.py: using CellId 25743 03:42:23.176286 tst cs_paging_gprs_active.py: using BVCI 25744 03:42:23.285358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.296315 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.307111 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.318544 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.329932 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.341400 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.352782 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.364102 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:23.375450 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:23.493415 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:23.607780 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:42:23.807945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:24.106336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22313): Launched 03:42:24.361766 run iperf3-srv_10.42.42.10(pid=22314): Launched 03:42:24.472015 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:42:24.670190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:24.966761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22315): Launched 03:42:25.223553 run iperf3-srv_10.42.42.10(pid=22316): Launched 03:42:25.333871 tst cs_paging_gprs_active.py:38: start network... 03:42:25.531742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:25.987368 run create_hlr_db(pid=22317): Launched 03:42:26.099562 bus /gobi_6: Setting Powered False 03:42:27.158881 run create_hlr_db(pid=22317): Terminated: ok {rc=0} 03:42:27.590990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22319): Launched 03:42:27.908250 run osmo-hlr_10.42.42.2(pid=22320): Launched 03:42:28.028743 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:28.575052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22322): Launched 03:42:28.889790 run osmo-stp_10.42.42.5(pid=22323): Launched 03:42:29.009154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:29.552181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22325): Launched 03:42:29.672472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:29.938250 run patchelf(pid=22326): Launched 03:42:30.113117 run osmo-stp_10.42.42.5(pid=22323): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22323)] 03:42:30.246398 run osmo-stp_10.42.42.5(pid=22323): stdout: | (launched: 2022-12-10_03:42:28.832121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:30.382137 run osmo-stp_10.42.42.5(pid=22323): stderr: | 20221210034229024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034229025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034229025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034229025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034229026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034229026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034229026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:30.517345 run osmo-stp_10.42.42.5(pid=22323): stdout: | (launched: 2022-12-10_03:42:28.832121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:30.646359 run osmo-stp_10.42.42.5(pid=22323): stderr: | 20221210034229024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034229025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034229025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034229025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034229026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034229026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034229026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:30.799704 run patchelf(pid=22326): Terminating (SIGINT) 03:42:30.994353 run patchelf(pid=22326): Terminated: ok {rc=0} 03:42:31.131916 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22323): Process ended prematurely: osmo-stp_10.42.42.5(pid=22323) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22323)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:42:31.142778 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:42:31.172014 run osmo-hlr_10.42.42.2(pid=22320): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22320)] 03:42:31.221946 run osmo-hlr_10.42.42.2(pid=22320): stdout: | (launched: 2022-12-10_03:42:27.848689) 03:42:31.273922 run osmo-hlr_10.42.42.2(pid=22320): stderr: | 20221210034228046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034228046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034228046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034228046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034228046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034228046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034228059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034228067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034228067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034228067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:31.340258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22313): Terminating (SIGTERM) 03:42:31.393305 run iperf3-srv_10.42.42.10(pid=22314): Terminating (SIGTERM) 03:42:31.443663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22315): Terminating (SIGTERM) 03:42:31.493338 run iperf3-srv_10.42.42.10(pid=22316): Terminating (SIGTERM) 03:42:31.543961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22319): Terminating (SIGTERM) 03:42:31.590132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22322): Terminating (SIGTERM) 03:42:31.632539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22325): Terminating (SIGTERM) 03:42:31.675000 --- ParallelTerminationStrategy: PID 22313 died... 03:42:31.694994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22313): Terminated: ok {rc=0} 03:42:31.742273 --- ParallelTerminationStrategy: PID 22314 died... 03:42:31.762249 run iperf3-srv_10.42.42.10(pid=22314): Terminated {rc=256} 03:42:31.809241 --- ParallelTerminationStrategy: PID 22315 died... 03:42:31.829190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22315): Terminated: ok {rc=0} 03:42:31.876552 --- ParallelTerminationStrategy: PID 22316 died... 03:42:31.896369 run iperf3-srv_10.42.42.10(pid=22316): Terminated {rc=256} 03:42:31.942317 --- ParallelTerminationStrategy: PID 22319 died... 03:42:31.962353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22319): Terminated: ok {rc=0} 03:42:32.007938 --- ParallelTerminationStrategy: PID 22322 died... 03:42:32.027474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22322): Terminated: ok {rc=0} 03:42:32.073522 --- ParallelTerminationStrategy: PID 22325 died... 03:42:32.092781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22325): Terminated: ok {rc=0} 03:42:32.179209 bus /gobi_0: Setting Powered False 03:42:33.276420 bus /gobi_0: Setting Powered False 03:42:34.391325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:42:35.535055 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:35.546499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:42:35.605347 tst iperf3.py: using LAC 25744 03:42:35.722717 tst iperf3.py: using RAC 244 03:42:35.838069 tst iperf3.py: using CellId 25744 03:42:35.957672 tst iperf3.py: using BVCI 25745 03:42:36.063985 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.074797 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.085524 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.096267 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.107143 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.117954 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.128867 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.139646 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:36.150638 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:36.266508 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:42:36.480659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:36.798182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22328): Launched 03:42:37.073245 run iperf3-srv_10.42.42.10(pid=22329): Launched 03:42:37.191130 tst iperf3.py:8: start network... 03:42:37.404160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:37.892390 run create_hlr_db(pid=22330): Launched 03:42:38.010710 bus /gobi_6: Setting Powered False 03:42:39.069719 run create_hlr_db(pid=22330): Terminated: ok {rc=0} 03:42:39.481299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22332): Launched 03:42:39.775284 run osmo-hlr_10.42.42.2(pid=22333): Launched 03:42:39.887691 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:40.393300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22335): Launched 03:42:40.687802 run osmo-stp_10.42.42.5(pid=22336): Launched 03:42:40.799745 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:41.308459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22338): Launched 03:42:41.421638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:41.670161 run patchelf(pid=22339): Launched 03:42:41.833410 run osmo-stp_10.42.42.5(pid=22336): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22336)] 03:42:41.958812 run osmo-stp_10.42.42.5(pid=22336): stdout: | (launched: 2022-12-10_03:42:40.633829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:42.085682 run osmo-stp_10.42.42.5(pid=22336): stderr: | 20221210034240804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034240804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034240804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034240805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034240805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034240805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034240805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:42.212694 run osmo-stp_10.42.42.5(pid=22336): stdout: | (launched: 2022-12-10_03:42:40.633829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:42.333686 run osmo-stp_10.42.42.5(pid=22336): stderr: | 20221210034240804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034240804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034240804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034240805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034240805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034240805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034240805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:42.477630 run patchelf(pid=22339): Terminating (SIGINT) 03:42:42.643767 run patchelf(pid=22339): Terminated: ok {rc=0} 03:42:42.764018 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22336): Process ended prematurely: osmo-stp_10.42.42.5(pid=22336) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22336)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 03:42:42.773629 tst iperf3.py:8: Test FAILED (7.3 sec) 03:42:42.801146 run osmo-hlr_10.42.42.2(pid=22333): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22333)] 03:42:42.848540 run osmo-hlr_10.42.42.2(pid=22333): stdout: | (launched: 2022-12-10_03:42:39.721587) 03:42:42.897243 run osmo-hlr_10.42.42.2(pid=22333): stderr: | 20221210034239897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034239897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034239897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034239897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034239897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034239897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034239927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034239937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034239938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034239938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:42.946391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22328): Terminating (SIGTERM) 03:42:42.985749 run iperf3-srv_10.42.42.10(pid=22329): Terminating (SIGTERM) 03:42:43.025044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22332): Terminating (SIGTERM) 03:42:43.064488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22335): Terminating (SIGTERM) 03:42:43.103703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22338): Terminating (SIGTERM) 03:42:43.143190 --- ParallelTerminationStrategy: PID 22328 died... 03:42:43.161976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22328): Terminated: ok {rc=0} 03:42:43.205682 --- ParallelTerminationStrategy: PID 22329 died... 03:42:43.223803 run iperf3-srv_10.42.42.10(pid=22329): Terminated {rc=256} 03:42:43.267383 --- ParallelTerminationStrategy: PID 22332 died... 03:42:43.285675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22332): Terminated: ok {rc=0} 03:42:43.329215 --- ParallelTerminationStrategy: PID 22335 died... 03:42:43.347335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22335): Terminated: ok {rc=0} 03:42:43.390862 --- ParallelTerminationStrategy: PID 22338 died... 03:42:43.409173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22338): Terminated: ok {rc=0} 03:42:43.493108 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:42:44.638668 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:44.650270 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:42:44.707200 tst iperf3m4.py: using LAC 25745 03:42:44.822358 tst iperf3m4.py: using RAC 245 03:42:44.939770 tst iperf3m4.py: using CellId 25745 03:42:45.054364 tst iperf3m4.py: using BVCI 25746 03:42:45.160587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.171399 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.181958 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.192701 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.203390 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.214161 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.225177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.235768 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:45.246692 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:45.363927 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:45.480599 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:45.597915 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:45.716258 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:42:45.937117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:46.248674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Launched 03:42:46.535831 run iperf3-srv_10.42.42.10(pid=22341): Launched 03:42:46.672899 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:42:46.893109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:47.230174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Launched 03:42:47.504485 run iperf3-srv_10.42.42.10(pid=22343): Launched 03:42:47.622360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:42:47.835275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:48.152184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Launched 03:42:48.427279 run iperf3-srv_10.42.42.10(pid=22345): Launched 03:42:48.544784 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:42:48.757586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:49.075098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22346): Launched 03:42:49.349452 run iperf3-srv_10.42.42.10(pid=22347): Launched 03:42:49.466695 tst iperf3m4.py:8: start network... 03:42:49.679088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:50.169563 run create_hlr_db(pid=22348): Launched 03:42:50.296127 bus /gobi_6: Setting Powered False 03:42:51.359338 run create_hlr_db(pid=22348): Terminated: ok {rc=0} 03:42:51.796430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22350): Launched 03:42:52.115390 run osmo-hlr_10.42.42.2(pid=22351): Launched 03:42:52.233953 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:52.778195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22353): Launched 03:42:53.091406 run osmo-stp_10.42.42.5(pid=22354): Launched 03:42:53.209544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:53.755002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22356): Launched 03:42:53.874907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:54.139557 run patchelf(pid=22357): Launched 03:42:54.313537 run osmo-stp_10.42.42.5(pid=22354): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22354)] 03:42:54.446375 run osmo-stp_10.42.42.5(pid=22354): stdout: | (launched: 2022-12-10_03:42:53.034394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:54.580930 run osmo-stp_10.42.42.5(pid=22354): stderr: | 20221210034253245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034253245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034253245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034253246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034253248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034253248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034253248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:54.715624 run osmo-stp_10.42.42.5(pid=22354): stdout: | (launched: 2022-12-10_03:42:53.034394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:54.844330 run osmo-stp_10.42.42.5(pid=22354): stderr: | 20221210034253245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034253245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034253245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034253246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034253248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034253248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034253248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:54.997253 run patchelf(pid=22357): Terminating (SIGINT) 03:42:55.173177 run patchelf(pid=22357): Terminated: ok {rc=0} 03:42:55.300104 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22354): Process ended prematurely: osmo-stp_10.42.42.5(pid=22354) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22354)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:42:55.310374 tst iperf3m4.py:8: Test FAILED (10.7 sec) 03:42:55.338687 run osmo-hlr_10.42.42.2(pid=22351): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22351)] 03:42:55.387906 run osmo-hlr_10.42.42.2(pid=22351): stdout: | (launched: 2022-12-10_03:42:52.057880) 03:42:55.438676 run osmo-hlr_10.42.42.2(pid=22351): stderr: | 20221210034252253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034252253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034252253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034252253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034252253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034252254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034252267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034252276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034252277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034252277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:55.489677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Terminating (SIGTERM) 03:42:55.530784 run iperf3-srv_10.42.42.10(pid=22341): Terminating (SIGTERM) 03:42:55.571761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Terminating (SIGTERM) 03:42:55.612881 run iperf3-srv_10.42.42.10(pid=22343): Terminating (SIGTERM) 03:42:55.653875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Terminating (SIGTERM) 03:42:55.694777 run iperf3-srv_10.42.42.10(pid=22345): Terminating (SIGTERM) 03:42:55.736068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22346): Terminating (SIGTERM) 03:42:55.777057 run iperf3-srv_10.42.42.10(pid=22347): Terminating (SIGTERM) 03:42:55.817849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22350): Terminating (SIGTERM) 03:42:55.859176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22353): Terminating (SIGTERM) 03:42:55.900327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22356): Terminating (SIGTERM) 03:42:55.941611 --- ParallelTerminationStrategy: PID 22340 died... 03:42:55.961303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Terminated: ok {rc=0} 03:42:56.006854 --- ParallelTerminationStrategy: PID 22341 died... 03:42:56.026142 run iperf3-srv_10.42.42.10(pid=22341): Terminated {rc=256} 03:42:56.071469 --- ParallelTerminationStrategy: PID 22342 died... 03:42:56.090849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Terminated: ok {rc=0} 03:42:56.136336 --- ParallelTerminationStrategy: PID 22343 died... 03:42:56.155594 run iperf3-srv_10.42.42.10(pid=22343): Terminated {rc=256} 03:42:56.200815 --- ParallelTerminationStrategy: PID 22344 died... 03:42:56.220429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Terminated: ok {rc=0} 03:42:56.265899 --- ParallelTerminationStrategy: PID 22345 died... 03:42:56.285166 run iperf3-srv_10.42.42.10(pid=22345): Terminated {rc=256} 03:42:56.330443 --- ParallelTerminationStrategy: PID 22346 died... 03:42:56.349545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22346): Terminated: ok {rc=0} 03:42:56.395126 --- ParallelTerminationStrategy: PID 22347 died... 03:42:56.414514 run iperf3-srv_10.42.42.10(pid=22347): Terminated {rc=256} 03:42:56.459677 --- ParallelTerminationStrategy: PID 22350 died... 03:42:56.478995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22350): Terminated: ok {rc=0} 03:42:56.524319 --- ParallelTerminationStrategy: PID 22353 died... 03:42:56.543683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22353): Terminated: ok {rc=0} 03:42:56.589302 --- ParallelTerminationStrategy: PID 22356 died... 03:42:56.608567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22356): Terminated: ok {rc=0} 03:42:56.694927 bus /gobi_4: Setting Powered False 03:42:57.793914 bus /gobi_4: Setting Powered False 03:42:58.909605 bus /gobi_1: Setting Powered False 03:43:00.007687 bus /gobi_1: Setting Powered False 03:43:01.127363 bus /gobi_0: Setting Powered False 03:43:02.227458 bus /gobi_0: Setting Powered False 03:43:03.343771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:43:04.442759 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:04.454070 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:04.510949 tst ping.py: using LAC 25746 03:43:04.626017 tst ping.py: using RAC 246 03:43:04.740057 tst ping.py: using CellId 25746 03:43:04.853122 tst ping.py: using BVCI 25747 03:43:04.958032 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:04.968858 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:04.979517 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:04.990225 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:05.001382 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:05.012234 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:05.023396 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:05.034345 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:05.145896 tst ping.py:19: start network... 03:43:05.340093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:05.788381 run create_hlr_db(pid=22358): Launched 03:43:05.898734 bus /gobi_6: Setting Powered False 03:43:06.957260 run create_hlr_db(pid=22358): Terminated: ok {rc=0} 03:43:07.381886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22360): Launched 03:43:07.691836 run osmo-hlr_10.42.42.2(pid=22361): Launched 03:43:07.809405 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:08.354860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22363): Launched 03:43:08.663755 run osmo-stp_10.42.42.5(pid=22364): Launched 03:43:08.782446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:09.317162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22366): Launched 03:43:09.434973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:09.695994 run patchelf(pid=22367): Launched 03:43:09.867319 run osmo-stp_10.42.42.5(pid=22364): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22364)] 03:43:09.998972 run osmo-stp_10.42.42.5(pid=22364): stdout: | (launched: 2022-12-10_03:43:08.607168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:10.131798 run osmo-stp_10.42.42.5(pid=22364): stderr: | 20221210034308797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034308797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034308797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034308797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034308798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034308798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034308798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:10.264666 run osmo-stp_10.42.42.5(pid=22364): stdout: | (launched: 2022-12-10_03:43:08.607168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:10.391486 run osmo-stp_10.42.42.5(pid=22364): stderr: | 20221210034308797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034308797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034308797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034308797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034308798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034308798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034308798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:10.541806 run patchelf(pid=22367): Terminating (SIGINT) 03:43:10.715170 run patchelf(pid=22367): Terminated: ok {rc=0} 03:43:10.840099 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22364): Process ended prematurely: osmo-stp_10.42.42.5(pid=22364) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22364)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 03:43:10.849981 tst ping.py:22: Test FAILED (6.4 sec) 03:43:10.877867 run osmo-hlr_10.42.42.2(pid=22361): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22361)] 03:43:10.927479 run osmo-hlr_10.42.42.2(pid=22361): stdout: | (launched: 2022-12-10_03:43:07.635182) 03:43:10.978272 run osmo-hlr_10.42.42.2(pid=22361): stderr: | 20221210034307833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034307833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034307833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034307833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034307833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034307833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034307845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034307855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034307855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034307855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:11.029495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22360): Terminating (SIGTERM) 03:43:11.071099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22363): Terminating (SIGTERM) 03:43:11.112661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22366): Terminating (SIGTERM) 03:43:11.154231 --- ParallelTerminationStrategy: PID 22360 died... 03:43:11.173966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22360): Terminated: ok {rc=0} 03:43:11.219688 --- ParallelTerminationStrategy: PID 22363 died... 03:43:11.239223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22363): Terminated: ok {rc=0} 03:43:11.284688 --- ParallelTerminationStrategy: PID 22366 died... 03:43:11.304036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22366): Terminated: ok {rc=0} 03:43:11.390588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:43:12.477887 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:12.490190 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:12.549032 tst ping_idle_ping.py: using LAC 25747 03:43:12.671446 tst ping_idle_ping.py: using RAC 247 03:43:12.792642 tst ping_idle_ping.py: using CellId 25747 03:43:12.917397 tst ping_idle_ping.py: using BVCI 25748 03:43:13.031177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:13.042451 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:13.053544 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:13.064483 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:13.075654 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:13.086784 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:13.098114 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:13.109152 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:13.222778 tst ping_idle_ping.py:24: start network... 03:43:13.418556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:13.871842 run create_hlr_db(pid=22368): Launched 03:43:13.983284 bus /gobi_6: Setting Powered False 03:43:15.041956 run create_hlr_db(pid=22368): Terminated: ok {rc=0} 03:43:15.467515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22370): Launched 03:43:15.777798 run osmo-hlr_10.42.42.2(pid=22371): Launched 03:43:15.976289 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:16.652157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22373): Launched 03:43:16.970920 run osmo-stp_10.42.42.5(pid=22374): Launched 03:43:17.208210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:17.863254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22376): Launched 03:43:17.981990 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:18.245403 run patchelf(pid=22377): Launched 03:43:18.417552 run osmo-stp_10.42.42.5(pid=22374): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22374)] 03:43:18.549271 run osmo-stp_10.42.42.5(pid=22374): stdout: | (launched: 2022-12-10_03:43:16.909794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:18.681704 run osmo-stp_10.42.42.5(pid=22374): stderr: | 20221210034317265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034317265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034317266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034317266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034317268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034317268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034317269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:18.814478 run osmo-stp_10.42.42.5(pid=22374): stdout: | (launched: 2022-12-10_03:43:16.909794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:18.941873 run osmo-stp_10.42.42.5(pid=22374): stderr: | 20221210034317265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034317265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034317266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034317266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034317268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034317268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034317269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:19.093981 run patchelf(pid=22377): Terminating (SIGINT) 03:43:19.267446 run patchelf(pid=22377): Terminated: ok {rc=0} 03:43:19.392109 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22374): Process ended prematurely: osmo-stp_10.42.42.5(pid=22374) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22374)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:43:19.401745 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 03:43:19.429156 run osmo-hlr_10.42.42.2(pid=22371): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22371)] 03:43:19.478158 run osmo-hlr_10.42.42.2(pid=22371): stdout: | (launched: 2022-12-10_03:43:15.721025) 03:43:19.528609 run osmo-hlr_10.42.42.2(pid=22371): stderr: | 20221210034315994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034315994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034315994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034315994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034315994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034315994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034316015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034316028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034316028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034316028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:19.579511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22370): Terminating (SIGTERM) 03:43:19.620366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22373): Terminating (SIGTERM) 03:43:19.661686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22376): Terminating (SIGTERM) 03:43:19.702919 --- ParallelTerminationStrategy: PID 22370 died... 03:43:19.722438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22370): Terminated: ok {rc=0} 03:43:19.767787 --- ParallelTerminationStrategy: PID 22373 died... 03:43:19.787207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22373): Terminated: ok {rc=0} 03:43:19.832407 --- ParallelTerminationStrategy: PID 22376 died... 03:43:19.851613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22376): Terminated: ok {rc=0} 03:43:19.937893 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:43:21.229112 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:43:21.235937 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:43:21.257930 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:43:21.297918 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:43:21.384878 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:43:21.406130 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:43:21.445276 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:43:22.043084 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:43:22.094464 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.105901 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:43:22.167540 tst cs_paging_gprs_active.py: using LAC 25748 03:43:22.291173 tst cs_paging_gprs_active.py: using RAC 248 03:43:22.413557 tst cs_paging_gprs_active.py: using CellId 25748 03:43:22.535723 tst cs_paging_gprs_active.py: using BVCI 25749 03:43:22.650396 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.661655 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.672589 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.683818 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.694930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.706228 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.717521 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.728798 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:22.740238 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:22.856594 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:22.974739 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:43:23.189975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:23.507485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22381): Launched 03:43:23.782385 run iperf3-srv_10.42.42.10(pid=22382): Launched 03:43:23.901093 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:43:24.114172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:24.431051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22383): Launched 03:43:24.705349 run iperf3-srv_10.42.42.10(pid=22384): Launched 03:43:24.823105 tst cs_paging_gprs_active.py:38: start network... 03:43:25.035881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:25.523936 run create_hlr_db(pid=22385): Launched 03:43:25.651202 bus /gobi_6: Setting Powered False 03:43:26.713802 run create_hlr_db(pid=22385): Terminated: ok {rc=0} 03:43:27.153107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22387): Launched 03:43:27.469515 run osmo-hlr_10.42.42.2(pid=22388): Launched 03:43:27.590048 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:28.130549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22390): Launched 03:43:28.443656 run osmo-stp_10.42.42.5(pid=22391): Launched 03:43:28.563932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:29.106336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22393): Launched 03:43:29.226548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:29.493395 run patchelf(pid=22394): Launched 03:43:29.668324 run osmo-stp_10.42.42.5(pid=22391): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22391)] 03:43:29.801877 run osmo-stp_10.42.42.5(pid=22391): stdout: | (launched: 2022-12-10_03:43:28.386331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:29.937522 run osmo-stp_10.42.42.5(pid=22391): stderr: | 20221210034328579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034328580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034328580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034328580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034328581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034328581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034328581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:30.072614 run osmo-stp_10.42.42.5(pid=22391): stdout: | (launched: 2022-12-10_03:43:28.386331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:30.201737 run osmo-stp_10.42.42.5(pid=22391): stderr: | 20221210034328579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034328580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034328580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034328580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034328581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034328581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034328581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:30.354698 run patchelf(pid=22394): Terminating (SIGINT) 03:43:30.531676 run patchelf(pid=22394): Terminated: ok {rc=0} 03:43:30.659025 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22391): Process ended prematurely: osmo-stp_10.42.42.5(pid=22391) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22391)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:43:30.669212 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:43:30.697219 run osmo-hlr_10.42.42.2(pid=22388): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22388)] 03:43:30.746314 run osmo-hlr_10.42.42.2(pid=22388): stdout: | (launched: 2022-12-10_03:43:27.411288) 03:43:30.796903 run osmo-hlr_10.42.42.2(pid=22388): stderr: | 20221210034327611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034327611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034327612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034327612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034327612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034327612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034327624 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034327633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034327633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034327633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:30.855702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22381): Terminating (SIGTERM) 03:43:30.897400 run iperf3-srv_10.42.42.10(pid=22382): Terminating (SIGTERM) 03:43:30.938534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22383): Terminating (SIGTERM) 03:43:30.980092 run iperf3-srv_10.42.42.10(pid=22384): Terminating (SIGTERM) 03:43:31.021840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22387): Terminating (SIGTERM) 03:43:31.063452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22390): Terminating (SIGTERM) 03:43:31.105519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22393): Terminating (SIGTERM) 03:43:31.150201 --- ParallelTerminationStrategy: PID 22381 died... 03:43:31.170560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22381): Terminated: ok {rc=0} 03:43:31.217043 --- ParallelTerminationStrategy: PID 22382 died... 03:43:31.237287 run iperf3-srv_10.42.42.10(pid=22382): Terminated {rc=256} 03:43:31.283789 --- ParallelTerminationStrategy: PID 22383 died... 03:43:31.303535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22383): Terminated: ok {rc=0} 03:43:31.351095 --- ParallelTerminationStrategy: PID 22384 died... 03:43:31.370972 run iperf3-srv_10.42.42.10(pid=22384): Terminated {rc=256} 03:43:31.417836 --- ParallelTerminationStrategy: PID 22387 died... 03:43:31.437610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22387): Terminated: ok {rc=0} 03:43:31.484165 --- ParallelTerminationStrategy: PID 22390 died... 03:43:31.503699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22390): Terminated: ok {rc=0} 03:43:31.550064 --- ParallelTerminationStrategy: PID 22393 died... 03:43:31.569802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22393): Terminated: ok {rc=0} 03:43:31.656018 bus /gobi_0: Setting Powered False 03:43:32.755565 bus /gobi_0: Setting Powered False 03:43:33.868403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:43:35.014087 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.025846 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:43:35.087102 tst iperf3.py: using LAC 25749 03:43:35.211359 tst iperf3.py: using RAC 249 03:43:35.334697 tst iperf3.py: using CellId 25749 03:43:35.458476 tst iperf3.py: using BVCI 25750 03:43:35.573787 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.585094 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.596173 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.607251 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.618365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.629462 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.640571 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.651537 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:35.662827 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:35.775758 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:43:35.975754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:36.273711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22395): Launched 03:43:36.530488 run iperf3-srv_10.42.42.10(pid=22396): Launched 03:43:36.641416 tst iperf3.py:8: start network... 03:43:36.840710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:37.297818 run create_hlr_db(pid=22397): Launched 03:43:37.410462 bus /gobi_6: Setting Powered False 03:43:38.469593 run create_hlr_db(pid=22397): Terminated: ok {rc=0} 03:43:38.901980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22399): Launched 03:43:39.216802 run osmo-hlr_10.42.42.2(pid=22400): Launched 03:43:39.337111 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:39.880936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22402): Launched 03:43:40.196026 run osmo-stp_10.42.42.5(pid=22403): Launched 03:43:40.315963 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:40.861070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22405): Launched 03:43:40.981861 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:41.248015 run patchelf(pid=22406): Launched 03:43:41.423581 run osmo-stp_10.42.42.5(pid=22403): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22403)] 03:43:41.557305 run osmo-stp_10.42.42.5(pid=22403): stdout: | (launched: 2022-12-10_03:43:40.138649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:41.692853 run osmo-stp_10.42.42.5(pid=22403): stderr: | 20221210034340332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034340332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034340332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034340333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034340333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034340333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034340333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:41.828493 run osmo-stp_10.42.42.5(pid=22403): stdout: | (launched: 2022-12-10_03:43:40.138649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:41.958463 run osmo-stp_10.42.42.5(pid=22403): stderr: | 20221210034340332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034340332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034340332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034340333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034340333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034340333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034340333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:42.111526 run patchelf(pid=22406): Terminating (SIGINT) 03:43:42.288289 run patchelf(pid=22406): Terminated: ok {rc=0} 03:43:42.415933 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22403): Process ended prematurely: osmo-stp_10.42.42.5(pid=22403) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22403)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 03:43:42.426191 tst iperf3.py:8: Test FAILED (7.4 sec) 03:43:42.454288 run osmo-hlr_10.42.42.2(pid=22400): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22400)] 03:43:42.503469 run osmo-hlr_10.42.42.2(pid=22400): stdout: | (launched: 2022-12-10_03:43:39.159493) 03:43:42.554652 run osmo-hlr_10.42.42.2(pid=22400): stderr: | 20221210034339357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034339357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034339357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034339357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034339357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034339357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034339377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034339388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034339388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034339388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:42.606287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22395): Terminating (SIGTERM) 03:43:42.647411 run iperf3-srv_10.42.42.10(pid=22396): Terminating (SIGTERM) 03:43:42.688601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22399): Terminating (SIGTERM) 03:43:42.729662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22402): Terminating (SIGTERM) 03:43:42.770791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22405): Terminating (SIGTERM) 03:43:42.812241 --- ParallelTerminationStrategy: PID 22395 died... 03:43:42.831965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22395): Terminated: ok {rc=0} 03:43:42.877979 --- ParallelTerminationStrategy: PID 22396 died... 03:43:42.897177 run iperf3-srv_10.42.42.10(pid=22396): Terminated {rc=256} 03:43:42.942822 --- ParallelTerminationStrategy: PID 22399 died... 03:43:42.962141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22399): Terminated: ok {rc=0} 03:43:43.007637 --- ParallelTerminationStrategy: PID 22402 died... 03:43:43.027057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22402): Terminated: ok {rc=0} 03:43:43.072586 --- ParallelTerminationStrategy: PID 22405 died... 03:43:43.092256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22405): Terminated: ok {rc=0} 03:43:43.178911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:43:44.325892 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.337868 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:43:44.397340 tst iperf3m4.py: using LAC 25750 03:43:44.520714 tst iperf3m4.py: using RAC 250 03:43:44.645379 tst iperf3m4.py: using CellId 25750 03:43:44.769465 tst iperf3m4.py: using BVCI 25751 03:43:44.885507 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.896730 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.907796 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.918970 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.929990 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.941049 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.952130 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.963089 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:44.974319 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:45.092498 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:45.208104 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:45.325803 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:45.444218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:43:45.657005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:45.990277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22407): Launched 03:43:46.276126 run iperf3-srv_10.42.42.10(pid=22408): Launched 03:43:46.408473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:43:46.623808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:46.951924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Launched 03:43:47.223889 run iperf3-srv_10.42.42.10(pid=22410): Launched 03:43:47.334477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:43:47.533464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:47.829300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22411): Launched 03:43:48.087083 run iperf3-srv_10.42.42.10(pid=22412): Launched 03:43:48.197240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:43:48.394350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:48.689859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22413): Launched 03:43:48.946302 run iperf3-srv_10.42.42.10(pid=22414): Launched 03:43:49.056515 tst iperf3m4.py:8: start network... 03:43:49.254201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:49.710410 run create_hlr_db(pid=22415): Launched 03:43:49.823235 bus /gobi_6: Setting Powered False 03:43:50.882571 run create_hlr_db(pid=22415): Terminated: ok {rc=0} 03:43:51.293878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22417): Launched 03:43:51.589648 run osmo-hlr_10.42.42.2(pid=22418): Launched 03:43:51.701505 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:52.226443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22420): Launched 03:43:52.521335 run osmo-stp_10.42.42.5(pid=22421): Launched 03:43:52.633501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:53.141185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22423): Launched 03:43:53.254464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:53.504219 run patchelf(pid=22424): Launched 03:43:53.668253 run osmo-stp_10.42.42.5(pid=22421): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22421)] 03:43:53.793897 run osmo-stp_10.42.42.5(pid=22421): stdout: | (launched: 2022-12-10_03:43:52.466576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:53.921147 run osmo-stp_10.42.42.5(pid=22421): stderr: | 20221210034352635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034352635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034352635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034352636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034352636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034352636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034352636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:54.048769 run osmo-stp_10.42.42.5(pid=22421): stdout: | (launched: 2022-12-10_03:43:52.466576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:54.169876 run osmo-stp_10.42.42.5(pid=22421): stderr: | 20221210034352635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034352635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034352635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034352636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034352636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034352636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034352636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:54.313999 run patchelf(pid=22424): Terminating (SIGINT) 03:43:54.480142 run patchelf(pid=22424): Terminated: ok {rc=0} 03:43:54.600449 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22421): Process ended prematurely: osmo-stp_10.42.42.5(pid=22421) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22421)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:43:54.610340 tst iperf3m4.py:8: Test FAILED (10.3 sec) 03:43:54.638295 run osmo-hlr_10.42.42.2(pid=22418): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22418)] 03:43:54.685753 run osmo-hlr_10.42.42.2(pid=22418): stdout: | (launched: 2022-12-10_03:43:51.535183) 03:43:54.734368 run osmo-hlr_10.42.42.2(pid=22418): stderr: | 20221210034351708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034351708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034351708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034351708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034351708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034351708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034351721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034351729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034351729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034351730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:54.783796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22407): Terminating (SIGTERM) 03:43:54.823301 run iperf3-srv_10.42.42.10(pid=22408): Terminating (SIGTERM) 03:43:54.862979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Terminating (SIGTERM) 03:43:54.902811 run iperf3-srv_10.42.42.10(pid=22410): Terminating (SIGTERM) 03:43:54.942713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22411): Terminating (SIGTERM) 03:43:54.982835 run iperf3-srv_10.42.42.10(pid=22412): Terminating (SIGTERM) 03:43:55.022855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22413): Terminating (SIGTERM) 03:43:55.062726 run iperf3-srv_10.42.42.10(pid=22414): Terminating (SIGTERM) 03:43:55.102352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22417): Terminating (SIGTERM) 03:43:55.142173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22420): Terminating (SIGTERM) 03:43:55.181979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22423): Terminating (SIGTERM) 03:43:55.222362 --- ParallelTerminationStrategy: PID 22407 died... 03:43:55.241307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22407): Terminated: ok {rc=0} 03:43:55.285719 --- ParallelTerminationStrategy: PID 22408 died... 03:43:55.304116 run iperf3-srv_10.42.42.10(pid=22408): Terminated {rc=256} 03:43:55.348264 --- ParallelTerminationStrategy: PID 22409 died... 03:43:55.366872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Terminated: ok {rc=0} 03:43:55.410783 --- ParallelTerminationStrategy: PID 22410 died... 03:43:55.429324 run iperf3-srv_10.42.42.10(pid=22410): Terminated {rc=256} 03:43:55.472757 --- ParallelTerminationStrategy: PID 22411 died... 03:43:55.491036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22411): Terminated: ok {rc=0} 03:43:55.534718 --- ParallelTerminationStrategy: PID 22412 died... 03:43:55.553118 run iperf3-srv_10.42.42.10(pid=22412): Terminated {rc=256} 03:43:55.596465 --- ParallelTerminationStrategy: PID 22413 died... 03:43:55.614647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22413): Terminated: ok {rc=0} 03:43:55.657887 --- ParallelTerminationStrategy: PID 22414 died... 03:43:55.676391 run iperf3-srv_10.42.42.10(pid=22414): Terminated {rc=256} 03:43:55.720097 --- ParallelTerminationStrategy: PID 22417 died... 03:43:55.738650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22417): Terminated: ok {rc=0} 03:43:55.782592 --- ParallelTerminationStrategy: PID 22420 died... 03:43:55.800916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22420): Terminated: ok {rc=0} 03:43:55.844660 --- ParallelTerminationStrategy: PID 22423 died... 03:43:55.863172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22423): Terminated: ok {rc=0} 03:43:55.947298 bus /gobi_4: Setting Powered False 03:43:57.045518 bus /gobi_4: Setting Powered False 03:43:58.159025 bus /gobi_1: Setting Powered False 03:43:59.255428 bus /gobi_1: Setting Powered False 03:44:00.365167 bus /gobi_0: Setting Powered False 03:44:01.460636 bus /gobi_0: Setting Powered False 03:44:02.577162 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:44:03.678322 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:03.690121 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:03.748730 tst ping.py: using LAC 25751 03:44:03.869523 tst ping.py: using RAC 251 03:44:03.990755 tst ping.py: using CellId 25751 03:44:04.111452 tst ping.py: using BVCI 25752 03:44:04.223165 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:04.234587 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:04.245646 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:04.256578 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:04.267506 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:04.278466 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:04.289712 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:04.300619 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:04.416289 tst ping.py:19: start network... 03:44:04.625186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:05.103672 run create_hlr_db(pid=22426): Launched 03:44:05.231557 bus /gobi_6: Setting Powered False 03:44:06.294351 run create_hlr_db(pid=22426): Terminated: ok {rc=0} 03:44:06.710249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22428): Launched 03:44:07.000496 run osmo-hlr_10.42.42.2(pid=22429): Launched 03:44:07.111409 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:07.614163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22431): Launched 03:44:07.925509 run osmo-stp_10.42.42.5(pid=22432): Launched 03:44:08.042786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:08.575939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22434): Launched 03:44:08.694370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:08.956795 run patchelf(pid=22435): Launched 03:44:09.129154 run osmo-stp_10.42.42.5(pid=22432): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22432)] 03:44:09.261130 run osmo-stp_10.42.42.5(pid=22432): stdout: | (launched: 2022-12-10_03:44:07.868489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:09.394057 run osmo-stp_10.42.42.5(pid=22432): stderr: | 20221210034408059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034408059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034408060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034408060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034408061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034408061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034408061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:09.527492 run osmo-stp_10.42.42.5(pid=22432): stdout: | (launched: 2022-12-10_03:44:07.868489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:09.655275 run osmo-stp_10.42.42.5(pid=22432): stderr: | 20221210034408059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034408059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034408060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034408060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034408061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034408061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034408061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:09.806106 run patchelf(pid=22435): Terminating (SIGINT) 03:44:09.980164 run patchelf(pid=22435): Terminated: ok {rc=0} 03:44:10.105595 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22432): Process ended prematurely: osmo-stp_10.42.42.5(pid=22432) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22432)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 03:44:10.115210 tst ping.py:22: Test FAILED (6.4 sec) 03:44:10.143183 run osmo-hlr_10.42.42.2(pid=22429): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22429)] 03:44:10.192286 run osmo-hlr_10.42.42.2(pid=22429): stdout: | (launched: 2022-12-10_03:44:06.947044) 03:44:10.242989 run osmo-hlr_10.42.42.2(pid=22429): stderr: | 20221210034407120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034407121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034407121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034407121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034407121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034407121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034407133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034407141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034407142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034407142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:10.294607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22428): Terminating (SIGTERM) 03:44:10.336145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22431): Terminating (SIGTERM) 03:44:10.377469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22434): Terminating (SIGTERM) 03:44:10.418918 --- ParallelTerminationStrategy: PID 22428 died... 03:44:10.438730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22428): Terminated: ok {rc=0} 03:44:10.484499 --- ParallelTerminationStrategy: PID 22431 died... 03:44:10.503776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22431): Terminated: ok {rc=0} 03:44:10.549353 --- ParallelTerminationStrategy: PID 22434 died... 03:44:10.568571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22434): Terminated: ok {rc=0} 03:44:10.654435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:44:11.740255 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:11.752408 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:11.812016 tst ping_idle_ping.py: using LAC 25752 03:44:11.935316 tst ping_idle_ping.py: using RAC 252 03:44:12.051098 tst ping_idle_ping.py: using CellId 25752 03:44:12.165046 tst ping_idle_ping.py: using BVCI 25753 03:44:12.270515 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:12.281560 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:12.292269 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:12.303076 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:12.314053 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:12.324807 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:12.335849 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:12.346784 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:12.462295 tst ping_idle_ping.py:24: start network... 03:44:12.661668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:13.113817 run create_hlr_db(pid=22436): Launched 03:44:13.223438 bus /gobi_6: Setting Powered False 03:44:14.281871 run create_hlr_db(pid=22436): Terminated: ok {rc=0} 03:44:14.687467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22438): Launched 03:44:14.978344 run osmo-hlr_10.42.42.2(pid=22439): Launched 03:44:15.088812 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:15.591640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22441): Launched 03:44:15.901729 run osmo-stp_10.42.42.5(pid=22442): Launched 03:44:16.106309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:16.802979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22444): Launched 03:44:16.931300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:17.209564 run patchelf(pid=22445): Launched 03:44:17.410266 run osmo-stp_10.42.42.5(pid=22442): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22442)] 03:44:17.535325 run osmo-stp_10.42.42.5(pid=22442): stdout: | (launched: 2022-12-10_03:44:15.828514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:17.660695 run osmo-stp_10.42.42.5(pid=22442): stderr: | 20221210034416175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034416175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034416175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034416176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034416176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034416176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034416176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:17.786335 run osmo-stp_10.42.42.5(pid=22442): stdout: | (launched: 2022-12-10_03:44:15.828514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:17.905920 run osmo-stp_10.42.42.5(pid=22442): stderr: | 20221210034416175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034416175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034416175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034416176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034416176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034416176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034416176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:18.047308 run patchelf(pid=22445): Terminating (SIGINT) 03:44:18.210730 run patchelf(pid=22445): Terminated: ok {rc=0} 03:44:18.329387 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22442): Process ended prematurely: osmo-stp_10.42.42.5(pid=22442) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22442)] [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:44:18.338446 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:44:18.365729 run osmo-hlr_10.42.42.2(pid=22439): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22439)] 03:44:18.413413 run osmo-hlr_10.42.42.2(pid=22439): stdout: | (launched: 2022-12-10_03:44:14.924651) 03:44:18.462624 run osmo-hlr_10.42.42.2(pid=22439): stderr: | 20221210034415097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034415097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034415097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034415097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034415097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034415097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034415110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034415119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034415119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034415119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:18.512498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22438): Terminating (SIGTERM) 03:44:18.552320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22441): Terminating (SIGTERM) 03:44:18.592089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22444): Terminating (SIGTERM) 03:44:18.632204 --- ParallelTerminationStrategy: PID 22438 died... 03:44:18.651175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22438): Terminated: ok {rc=0} 03:44:18.695376 --- ParallelTerminationStrategy: PID 22441 died... 03:44:18.713822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22441): Terminated: ok {rc=0} 03:44:18.758195 --- ParallelTerminationStrategy: PID 22444 died... 03:44:18.776710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22444): Terminated: ok {rc=0} 03:44:18.860030 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:44:20.144574 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:44:20.151005 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:44:20.171515 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:44:20.206076 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:44:20.256490 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:44:20.276896 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:44:20.311278 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:44:20.872880 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:44:20.878907 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:20.891048 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:44:20.945558 tst switch_tch_pdch.py: using LAC 25753 03:44:21.060728 tst switch_tch_pdch.py: using RAC 253 03:44:21.172831 tst switch_tch_pdch.py: using CellId 25753 03:44:21.284526 tst switch_tch_pdch.py: using BVCI 25754 03:44:21.388864 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:21.400075 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:21.411007 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:21.422167 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:21.433232 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:21.444255 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:21.455535 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:21.466708 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:44:21.578011 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:44:21.691005 tst switch_tch_pdch.py:51: start network... 03:44:21.884798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:22.332942 run create_hlr_db(pid=22450): Launched 03:44:22.443095 bus /gobi_6: Setting Powered False 03:44:23.501882 run create_hlr_db(pid=22450): Terminated: ok {rc=0} 03:44:23.926879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22452): Launched 03:44:24.235677 run osmo-hlr_10.42.42.2(pid=22453): Launched 03:44:24.353473 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:24.891801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22455): Launched 03:44:25.201594 run osmo-stp_10.42.42.5(pid=22456): Launched 03:44:25.319206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:25.854557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22458): Launched 03:44:25.973081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:26.234363 run patchelf(pid=22459): Launched 03:44:26.405434 run osmo-stp_10.42.42.5(pid=22456): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22456)] 03:44:26.537332 run osmo-stp_10.42.42.5(pid=22456): stdout: | (launched: 2022-12-10_03:44:25.144820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:26.670309 run osmo-stp_10.42.42.5(pid=22456): stderr: | 20221210034425335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034425335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034425336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034425336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034425337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034425337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034425337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:26.803327 run osmo-stp_10.42.42.5(pid=22456): stdout: | (launched: 2022-12-10_03:44:25.144820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:26.930560 run osmo-stp_10.42.42.5(pid=22456): stderr: | 20221210034425335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034425335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034425336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034425336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034425337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034425337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034425337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:27.081204 run patchelf(pid=22459): Terminating (SIGINT) 03:44:27.254987 run patchelf(pid=22459): Terminated: ok {rc=0} 03:44:27.380402 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22456): Process ended prematurely: osmo-stp_10.42.42.5(pid=22456) [trial-2369↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22456)] [trial-2369↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:44:27.390022 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:44:27.417864 run osmo-hlr_10.42.42.2(pid=22453): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22453)] 03:44:27.467344 run osmo-hlr_10.42.42.2(pid=22453): stdout: | (launched: 2022-12-10_03:44:24.179176) 03:44:27.518602 run osmo-hlr_10.42.42.2(pid=22453): stderr: | 20221210034424376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034424376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034424376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034424376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034424376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034424376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034424388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034424397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034424397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034424397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:27.570001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22452): Terminating (SIGTERM) 03:44:27.611550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22455): Terminating (SIGTERM) 03:44:27.653040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22458): Terminating (SIGTERM) 03:44:27.695118 --- ParallelTerminationStrategy: PID 22452 died... 03:44:27.715123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22452): Terminated: ok {rc=0} 03:44:27.761310 --- ParallelTerminationStrategy: PID 22455 died... 03:44:27.780718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22455): Terminated: ok {rc=0} 03:44:27.826142 --- ParallelTerminationStrategy: PID 22458 died... 03:44:27.845542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22458): Terminated: ok {rc=0} 03:44:27.932449 bus /gobi_0: Setting Powered False 03:44:29.030805 bus /gobi_0: Setting Powered False 03:44:30.147645 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:44:31.406979 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:44:31.412486 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:44:31.436261 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:44:31.473605 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:44:31.530424 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:44:31.556740 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:44:31.603130 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:44:32.147397 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:44:32.153449 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.165331 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:44:32.225064 tst switch_tch_pdch.py: using LAC 25754 03:44:32.345057 tst switch_tch_pdch.py: using RAC 254 03:44:32.466588 tst switch_tch_pdch.py: using CellId 25754 03:44:32.589397 tst switch_tch_pdch.py: using BVCI 25755 03:44:32.701276 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.712691 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.724119 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.735369 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.746527 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.757489 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.768610 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:32.779744 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:44:32.891818 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:44:33.006866 tst switch_tch_pdch.py:51: start network... 03:44:33.201133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:33.624271 run create_hlr_db(pid=22464): Launched 03:44:33.735261 bus /gobi_6: Setting Powered False 03:44:34.794603 run create_hlr_db(pid=22464): Terminated: ok {rc=0} 03:44:35.192440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Launched 03:44:35.502729 run osmo-hlr_10.42.42.2(pid=22467): Launched 03:44:35.622674 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:36.133416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Launched 03:44:36.441852 run osmo-stp_10.42.42.5(pid=22470): Launched 03:44:36.561105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:37.070162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Launched 03:44:37.187836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:37.449830 run patchelf(pid=22473): Launched 03:44:37.621191 run osmo-stp_10.42.42.5(pid=22470): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] 03:44:37.753273 run osmo-stp_10.42.42.5(pid=22470): stdout: | (launched: 2022-12-10_03:44:36.385473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:37.886263 run osmo-stp_10.42.42.5(pid=22470): stderr: | 20221210034436575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034436575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034436575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034436576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034436578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034436578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034436578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:38.019680 run osmo-stp_10.42.42.5(pid=22470): stdout: | (launched: 2022-12-10_03:44:36.385473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:38.146872 run osmo-stp_10.42.42.5(pid=22470): stderr: | 20221210034436575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034436575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034436575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034436576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034436578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034436578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034436578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:38.297723 run patchelf(pid=22473): Terminating (SIGINT) 03:44:38.471299 run patchelf(pid=22473): Terminated: ok {rc=0} 03:44:38.596377 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22470): Process ended prematurely: osmo-stp_10.42.42.5(pid=22470) [trial-2369↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] [trial-2369↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:44:38.606076 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 03:44:38.633714 run osmo-hlr_10.42.42.2(pid=22467): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22467)] 03:44:38.683179 run osmo-hlr_10.42.42.2(pid=22467): stdout: | (launched: 2022-12-10_03:44:35.445998) 03:44:38.734119 run osmo-hlr_10.42.42.2(pid=22467): stderr: | 20221210034435643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034435643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034435643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034435644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034435644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034435644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034435656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034435664 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034435665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034435665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:38.785438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Terminating (SIGTERM) 03:44:38.826722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Terminating (SIGTERM) 03:44:38.868025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Terminating (SIGTERM) 03:44:38.910102 --- ParallelTerminationStrategy: PID 22466 died... 03:44:38.930056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Terminated: ok {rc=0} 03:44:38.976043 --- ParallelTerminationStrategy: PID 22469 died... 03:44:38.995264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Terminated: ok {rc=0} 03:44:39.041164 --- ParallelTerminationStrategy: PID 22472 died... 03:44:39.060416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Terminated: ok {rc=0} 03:44:39.146469 bus /gobi_0: Setting Powered False 03:44:40.245228 bus /gobi_0: Setting Powered False 03:44:41.361595 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_sms:oc2g --------------------------------------------------------------------- 03:44:42.595342 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:44:42.600081 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 03:44:42.621336 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 03:44:42.628617 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 03:44:42.681123 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 03:44:42.702194 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 03:44:42.709077 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 03:44:43.246808 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 03:44:43.251684 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 03:44:43.262710 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 03:44:43.297187 tst mo_mt_sms.py: using LAC 25755 03:44:43.418925 tst mo_mt_sms.py: using RAC 255 03:44:43.540406 tst mo_mt_sms.py: using CellId 25755 03:44:43.662180 tst mo_mt_sms.py: using BVCI 25756 03:44:43.774544 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 03:44:43.886480 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 03:44:44.004488 tst mo_mt_sms.py:9: start nitb and bts... 03:44:44.214542 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:44:44.847511 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22478): Launched 03:44:45.158473 run osmo-nitb_10.42.42.2(pid=22479): Launched 03:44:45.330020 run osmo-nitb_10.42.42.2(pid=22479): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22479)] 03:44:45.468875 run osmo-nitb_10.42.42.2(pid=22479): stdout: | (launched: 2022-12-10_03:44:45.101981) 03:44:45.609491 run osmo-nitb_10.42.42.2(pid=22479): stderr: | (launched: 2022-12-10_03:44:45.147879) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:44:45.750126 run osmo-nitb_10.42.42.2(pid=22479): stdout: | (launched: 2022-12-10_03:44:45.101981) 03:44:45.895987 run osmo-nitb_10.42.42.2(pid=22479): stderr: | (launched: 2022-12-10_03:44:45.147879) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22479): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22479) [trial-2369↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22479)] 03:44:46.275205 tst osmo-nitb_10.42.42.2(pid=22479): stdout: | (launched: 2022-12-10_03:44:45.101981) 03:44:46.426007 tst osmo-nitb_10.42.42.2(pid=22479): stderr: | (launched: 2022-12-10_03:44:45.147879) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:44:46.571176 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22479): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22479) [trial-2369↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22479)] [trial-2369↪nitb_sms:oc2g↪mo_mt_sms.py:11] 03:44:46.580568 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 03:44:46.587714 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22478): Terminating (SIGTERM) 03:44:46.799246 --- ParallelTerminationStrategy: PID 22478 died... 03:44:46.824333 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22478): Terminated: ok {rc=0} 03:44:46.925466 bus /sierra_3: Setting Powered False 03:44:48.021435 bus /sierra_3: Setting Powered False 03:44:49.136376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:oc2g --------------------------------------------------------------------- 03:44:50.314314 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:44:50.318150 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 03:44:50.338260 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 03:44:50.365442 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 03:44:50.417184 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 03:44:50.437990 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 03:44:50.464646 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 03:44:51.008475 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:oc2g mo_mt_sms.py ---------------------------------------------- 03:44:51.013268 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:44:51.023512 tst sms:oc2g: Using 1 x bts (candidates: 1) 03:44:51.057389 tst mo_mt_sms.py: using LAC 25756 03:44:51.172441 tst mo_mt_sms.py: using RAC 1 03:44:51.284051 tst mo_mt_sms.py: using CellId 25756 03:44:51.396802 tst mo_mt_sms.py: using BVCI 25757 03:44:51.501186 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:44:51.511581 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:44:51.521968 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:44:51.532402 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:44:51.542883 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:44:51.553300 tst sms:oc2g: Using 1 x modem (candidates: 2) 03:44:51.663913 tst sms:oc2g: Using 1 x modem (candidates: 2) 03:44:51.781332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:52.263162 run create_hlr_db(pid=22483): Launched 03:44:52.388337 bus /sierra_2: Setting Powered False 03:44:53.448636 run create_hlr_db(pid=22483): Terminated: ok {rc=0} 03:44:53.864351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22485): Launched 03:44:54.154369 run osmo-hlr_10.42.42.2(pid=22486): Launched 03:44:54.263911 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:54.774977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22488): Launched 03:44:55.065015 run osmo-stp_10.42.42.5(pid=22489): Launched 03:44:55.175195 run osmo-msc_10.42.42.6: Starting osmo-msc 03:44:55.698517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22491): Launched 03:44:55.989035 run osmo-msc_10.42.42.6(pid=22492): Launched 03:44:56.151383 run osmo-stp_10.42.42.5(pid=22489): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22489)] 03:44:56.274357 run osmo-stp_10.42.42.5(pid=22489): stdout: | (launched: 2022-12-10_03:44:55.011312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:56.398803 run osmo-stp_10.42.42.5(pid=22489): stderr: | 20221210034455179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034455179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034455179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034455180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034455180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034455180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034455180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:56.520181 run osmo-stp_10.42.42.5(pid=22489): stdout: | (launched: 2022-12-10_03:44:55.011312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:56.635830 run osmo-stp_10.42.42.5(pid=22489): stderr: | 20221210034455179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034455179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034455179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034455180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034455180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034455180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034455180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:56.774014 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22489): Process ended prematurely: osmo-stp_10.42.42.5(pid=22489) [trial-2369↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22489)] [trial-2369↪sms:oc2g↪mo_mt_sms.py:16] 03:44:56.782610 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 03:44:56.808743 run osmo-hlr_10.42.42.2(pid=22486): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22486)] 03:44:56.856084 run osmo-hlr_10.42.42.2(pid=22486): stdout: | (launched: 2022-12-10_03:44:54.100692) 03:44:56.904752 run osmo-hlr_10.42.42.2(pid=22486): stderr: | 20221210034454275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034454275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034454276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034454276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034454276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034454276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034454287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034454296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034454296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034454296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:56.972532 run osmo-msc_10.42.42.6(pid=22492): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22492)] 03:44:57.019490 run osmo-msc_10.42.42.6(pid=22492): stdout: | (launched: 2022-12-10_03:44:55.935239) 03:44:57.067939 run osmo-msc_10.42.42.6(pid=22492): stderr: | 20221210034456207 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034456207 DLGLOBAL DEBUG validating counter group 0x7fe7bea79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034456207 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034456207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034456207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034456208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034456210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034456210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034456210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034456210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:44:57.116932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22485): Terminating (SIGTERM) 03:44:57.156054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22488): Terminating (SIGTERM) 03:44:57.195082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22491): Terminating (SIGTERM) 03:44:57.234455 --- ParallelTerminationStrategy: PID 22485 died... 03:44:57.253010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22485): Terminated: ok {rc=0} 03:44:57.296376 --- ParallelTerminationStrategy: PID 22488 died... 03:44:57.314619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22488): Terminated: ok {rc=0} 03:44:57.358060 --- ParallelTerminationStrategy: PID 22491 died... 03:44:57.376308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22491): Terminated: ok {rc=0} 03:44:57.460382 bus /sierra_3: Setting Powered False 03:44:58.558496 bus /sierra_3: Setting Powered False 03:44:59.673123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:oc2g --------------------------------------------------------------------- 03:45:00.904138 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:00.908449 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 03:45:00.944649 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 03:45:00.956614 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 03:45:00.995443 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 03:45:01.029802 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 03:45:01.037684 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 03:45:01.546440 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 03:45:01.554140 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 03:45:01.569321 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 03:45:01.611432 tst assert_extension.py: using LAC 25757 03:45:01.770605 tst assert_extension.py: using RAC 2 03:45:01.904233 tst assert_extension.py: using CellId 25757 03:45:02.031559 tst assert_extension.py: using BVCI 25758 03:45:02.146080 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 03:45:02.265778 tst assert_extension.py:10: start nitb and bts... 03:45:02.478650 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:45:03.112093 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22500): Launched 03:45:03.421755 run osmo-nitb_10.42.42.2(pid=22501): Launched 03:45:03.592703 run osmo-nitb_10.42.42.2(pid=22501): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22501)] 03:45:03.731783 run osmo-nitb_10.42.42.2(pid=22501): stdout: | (launched: 2022-12-10_03:45:03.365161) 03:45:03.872092 run osmo-nitb_10.42.42.2(pid=22501): stderr: | (launched: 2022-12-10_03:45:03.411125) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:04.013938 run osmo-nitb_10.42.42.2(pid=22501): stdout: | (launched: 2022-12-10_03:45:03.365161) 03:45:04.148755 run osmo-nitb_10.42.42.2(pid=22501): stderr: | (launched: 2022-12-10_03:45:03.411125) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22501): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22501) [trial-2369↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22501)] 03:45:04.538503 tst osmo-nitb_10.42.42.2(pid=22501): stdout: | (launched: 2022-12-10_03:45:03.365161) 03:45:04.663727 tst osmo-nitb_10.42.42.2(pid=22501): stderr: | (launched: 2022-12-10_03:45:03.411125) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:04.811112 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22501): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22501) [trial-2369↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22501)] [trial-2369↪nitb_ussd:oc2g↪assert_extension.py:12] 03:45:04.820020 tst assert_extension.py:12: Test FAILED (3.3 sec) 03:45:04.827032 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22500): Terminating (SIGTERM) 03:45:05.036575 --- ParallelTerminationStrategy: PID 22500 died... 03:45:05.057753 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22500): Terminated: ok {rc=0} 03:45:05.143441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:oc2g --------------------------------------------------------------------- 03:45:06.301511 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:06.305333 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 03:45:06.325580 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 03:45:06.353122 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 03:45:06.389866 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 03:45:06.411352 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 03:45:06.439938 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 03:45:06.963544 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:oc2g assert_extension.py ---------------------------------------------- 03:45:06.969651 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:06.980423 tst ussd:oc2g: Using 1 x bts (candidates: 1) 03:45:07.015166 tst assert_extension.py: using LAC 25758 03:45:07.138242 tst assert_extension.py: using RAC 3 03:45:07.259328 tst assert_extension.py: using CellId 25758 03:45:07.377208 tst assert_extension.py: using BVCI 25759 03:45:07.483472 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:07.494169 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:07.504609 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:07.515434 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:07.526439 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:07.537293 tst ussd:oc2g: Using 1 x modem (candidates: 1) 03:45:07.652593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:08.134778 run create_hlr_db(pid=22505): Launched 03:45:08.260184 bus /sierra_2: Setting Powered False 03:45:09.322965 run create_hlr_db(pid=22505): Terminated: ok {rc=0} 03:45:09.740044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22507): Launched 03:45:10.031916 run osmo-hlr_10.42.42.2(pid=22508): Launched 03:45:10.143522 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:10.659772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22510): Launched 03:45:10.950227 run osmo-stp_10.42.42.5(pid=22511): Launched 03:45:11.061056 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:11.586059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22513): Launched 03:45:11.876137 run osmo-msc_10.42.42.6(pid=22514): Launched 03:45:12.039750 run osmo-stp_10.42.42.5(pid=22511): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22511)] 03:45:12.163232 run osmo-stp_10.42.42.5(pid=22511): stdout: | (launched: 2022-12-10_03:45:10.896678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:12.287184 run osmo-stp_10.42.42.5(pid=22511): stderr: | 20221210034511064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034511064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034511064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034511064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034511065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034511065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034511065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:12.407899 run osmo-stp_10.42.42.5(pid=22511): stdout: | (launched: 2022-12-10_03:45:10.896678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:12.523517 run osmo-stp_10.42.42.5(pid=22511): stderr: | 20221210034511064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034511064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034511064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034511064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034511065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034511065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034511065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:12.662104 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22511): Process ended prematurely: osmo-stp_10.42.42.5(pid=22511) [trial-2369↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22511)] [trial-2369↪ussd:oc2g↪assert_extension.py:17] 03:45:12.670701 tst assert_extension.py:17: Test FAILED (5.7 sec) 03:45:12.697469 run osmo-hlr_10.42.42.2(pid=22508): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22508)] 03:45:12.744387 run osmo-hlr_10.42.42.2(pid=22508): stdout: | (launched: 2022-12-10_03:45:09.977912) 03:45:12.793104 run osmo-hlr_10.42.42.2(pid=22508): stderr: | 20221210034510154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034510154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034510154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034510154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034510154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034510154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034510166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034510174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034510175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034510175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:12.860686 run osmo-msc_10.42.42.6(pid=22514): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22514)] 03:45:12.907504 run osmo-msc_10.42.42.6(pid=22514): stdout: | (launched: 2022-12-10_03:45:11.822258) 03:45:12.956627 run osmo-msc_10.42.42.6(pid=22514): stderr: | 20221210034512093 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034512093 DLGLOBAL DEBUG validating counter group 0x7f397ebf5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034512093 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034512093 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034512093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034512094 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034512096 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034512096 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034512096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034512096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:13.005804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22507): Terminating (SIGTERM) 03:45:13.045138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22510): Terminating (SIGTERM) 03:45:13.084425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22513): Terminating (SIGTERM) 03:45:13.124025 --- ParallelTerminationStrategy: PID 22507 died... 03:45:13.142751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22507): Terminated: ok {rc=0} 03:45:13.186481 --- ParallelTerminationStrategy: PID 22510 died... 03:45:13.204792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22510): Terminated: ok {rc=0} 03:45:13.248164 --- ParallelTerminationStrategy: PID 22513 died... 03:45:13.266462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22513): Terminated: ok {rc=0} 03:45:13.348203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:45:14.544271 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:14.551443 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:45:14.573987 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:45:14.602287 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:45:14.655196 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:45:14.675929 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:45:14.703770 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:45:15.252211 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:45:15.301765 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:15.312864 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:45:15.367667 tst mo_mt_call.py: using LAC 25759 03:45:15.483665 tst mo_mt_call.py: using RAC 4 03:45:15.601369 tst mo_mt_call.py: using CellId 25759 03:45:15.720236 tst mo_mt_call.py: using BVCI 25760 03:45:15.831756 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:15.851986 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:15.864871 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:15.878120 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:15.897173 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:15.910062 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:16.035901 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:16.156095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:16.637418 run create_hlr_db(pid=22519): Launched 03:45:16.800895 bus /sierra_2: Setting Powered False 03:45:17.863470 run create_hlr_db(pid=22519): Terminated: ok {rc=0} 03:45:18.289663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22521): Launched 03:45:18.586105 run osmo-hlr_10.42.42.2(pid=22522): Launched 03:45:18.699785 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:19.211211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22524): Launched 03:45:19.507222 run osmo-stp_10.42.42.5(pid=22525): Launched 03:45:19.620500 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:20.155265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22527): Launched 03:45:20.450982 run osmo-msc_10.42.42.6(pid=22528): Launched 03:45:20.615236 run osmo-stp_10.42.42.5(pid=22525): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22525)] 03:45:20.739614 run osmo-stp_10.42.42.5(pid=22525): stdout: | (launched: 2022-12-10_03:45:19.452813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:20.865374 run osmo-stp_10.42.42.5(pid=22525): stderr: | 20221210034519624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034519624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034519624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034519624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034519625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034519625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034519625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:20.988712 run osmo-stp_10.42.42.5(pid=22525): stdout: | (launched: 2022-12-10_03:45:19.452813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:21.106583 run osmo-stp_10.42.42.5(pid=22525): stderr: | 20221210034519624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034519624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034519624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034519624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034519625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034519625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034519625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:21.247906 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22525): Process ended prematurely: osmo-stp_10.42.42.5(pid=22525) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22525)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:45:21.257044 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:45:21.283700 run osmo-hlr_10.42.42.2(pid=22522): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22522)] 03:45:21.331430 run osmo-hlr_10.42.42.2(pid=22522): stdout: | (launched: 2022-12-10_03:45:18.531606) 03:45:21.380329 run osmo-hlr_10.42.42.2(pid=22522): stderr: | 20221210034518705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034518705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034518705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034518705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034518705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034518705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034518717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034518726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034518726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034518726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:21.448095 run osmo-msc_10.42.42.6(pid=22528): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22528)] 03:45:21.495344 run osmo-msc_10.42.42.6(pid=22528): stdout: | (launched: 2022-12-10_03:45:20.396446) 03:45:21.544118 run osmo-msc_10.42.42.6(pid=22528): stderr: | 20221210034520670 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034520671 DLGLOBAL DEBUG validating counter group 0x7f6f3164dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034520671 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034520671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034520671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034520671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034520673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034520673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034520674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034520674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:21.593276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22521): Terminating (SIGTERM) 03:45:21.632449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22524): Terminating (SIGTERM) 03:45:21.671869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22527): Terminating (SIGTERM) 03:45:21.711361 --- ParallelTerminationStrategy: PID 22521 died... 03:45:21.730229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22521): Terminated: ok {rc=0} 03:45:21.774665 --- ParallelTerminationStrategy: PID 22524 died... 03:45:21.793188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22524): Terminated: ok {rc=0} 03:45:21.837047 --- ParallelTerminationStrategy: PID 22527 died... 03:45:21.855501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22527): Terminated: ok {rc=0} 03:45:21.940808 bus /sierra_3: Setting Powered False 03:45:23.038029 bus /sierra_3: Setting Powered False 03:45:24.151985 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:45:25.295277 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:25.306965 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:45:25.362735 tst mo_mt_call_osmux.py: using LAC 25760 03:45:25.478701 tst mo_mt_call_osmux.py: using RAC 5 03:45:25.597370 tst mo_mt_call_osmux.py: using CellId 25760 03:45:25.721303 tst mo_mt_call_osmux.py: using BVCI 25761 03:45:25.836139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:25.847674 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:25.859141 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:25.870461 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:25.881892 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:25.893310 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:26.008796 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:26.123247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:26.585581 run create_hlr_db(pid=22530): Launched 03:45:26.699422 bus /sierra_2: Setting Powered False 03:45:27.758874 run create_hlr_db(pid=22530): Terminated: ok {rc=0} 03:45:28.194248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22532): Launched 03:45:28.511323 run osmo-hlr_10.42.42.2(pid=22533): Launched 03:45:28.633396 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:29.178672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22535): Launched 03:45:29.494097 run osmo-stp_10.42.42.5(pid=22536): Launched 03:45:29.615570 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:30.187661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22538): Launched 03:45:30.502874 run osmo-msc_10.42.42.6(pid=22539): Launched 03:45:30.680821 run osmo-stp_10.42.42.5(pid=22536): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22536)] 03:45:30.813990 run osmo-stp_10.42.42.5(pid=22536): stdout: | (launched: 2022-12-10_03:45:29.436487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:31.080863 run osmo-stp_10.42.42.5(pid=22536): stderr: | 20221210034529628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034529628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034529629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034529629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034529630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034529630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034529630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:31.209811 run osmo-stp_10.42.42.5(pid=22536): stdout: | (launched: 2022-12-10_03:45:29.436487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:31.332696 run osmo-stp_10.42.42.5(pid=22536): stderr: | 20221210034529628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034529628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034529629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034529629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034529630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034529630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034529630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:31.479024 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22536): Process ended prematurely: osmo-stp_10.42.42.5(pid=22536) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22536)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:45:31.489055 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:45:31.519713 run osmo-hlr_10.42.42.2(pid=22533): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22533)] 03:45:31.569650 run osmo-hlr_10.42.42.2(pid=22533): stdout: | (launched: 2022-12-10_03:45:28.453718) 03:45:31.621495 run osmo-hlr_10.42.42.2(pid=22533): stderr: | 20221210034528650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034528650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034528650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034528650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034528650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034528650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034528662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034528670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034528671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034528671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:31.692024 run osmo-msc_10.42.42.6(pid=22539): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22539)] 03:45:31.742728 run osmo-msc_10.42.42.6(pid=22539): stdout: | (launched: 2022-12-10_03:45:30.445347) 03:45:31.793811 run osmo-msc_10.42.42.6(pid=22539): stderr: | 20221210034530768 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034530769 DLGLOBAL DEBUG validating counter group 0x7f1bced64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034530769 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034530769 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034530769 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034530769 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034530771 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034530771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034530771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034530771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:31.845592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22532): Terminating (SIGTERM) 03:45:31.888369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22535): Terminating (SIGTERM) 03:45:31.933566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22538): Terminating (SIGTERM) 03:45:31.977502 --- ParallelTerminationStrategy: PID 22532 died... 03:45:31.997299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22532): Terminated: ok {rc=0} 03:45:32.045748 --- ParallelTerminationStrategy: PID 22535 died... 03:45:32.065449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22535): Terminated: ok {rc=0} 03:45:32.112120 --- ParallelTerminationStrategy: PID 22538 died... 03:45:32.131742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22538): Terminated: ok {rc=0} 03:45:32.219399 bus /sierra_3: Setting Powered False 03:45:33.315352 bus /sierra_3: Setting Powered False 03:45:34.429872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:45:35.663572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:35.670737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:45:35.691777 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:45:35.718925 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:45:35.771047 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:45:35.791953 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:45:35.818818 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:45:36.371084 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:45:36.421293 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:36.432632 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:45:36.490028 tst mo_mt_call.py: using LAC 25761 03:45:36.612942 tst mo_mt_call.py: using RAC 6 03:45:36.735675 tst mo_mt_call.py: using CellId 25761 03:45:36.863038 tst mo_mt_call.py: using BVCI 25762 03:45:36.979037 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:36.990585 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:37.001862 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:37.013073 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:37.024263 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:37.035537 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:45:37.149590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:45:37.264200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:37.755410 run create_hlr_db(pid=22544): Launched 03:45:37.883938 bus /sierra_2: Setting Powered False 03:45:38.947895 run create_hlr_db(pid=22544): Terminated: ok {rc=0} 03:45:39.372100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22546): Launched 03:45:39.668781 run osmo-hlr_10.42.42.2(pid=22547): Launched 03:45:39.781555 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:40.302592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22549): Launched 03:45:40.597942 run osmo-stp_10.42.42.5(pid=22550): Launched 03:45:40.709746 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:41.242533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22552): Launched 03:45:41.538129 run osmo-msc_10.42.42.6(pid=22553): Launched 03:45:41.703104 run osmo-stp_10.42.42.5(pid=22550): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22550)] 03:45:41.828828 run osmo-stp_10.42.42.5(pid=22550): stdout: | (launched: 2022-12-10_03:45:40.543611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:41.955162 run osmo-stp_10.42.42.5(pid=22550): stderr: | 20221210034540714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034540714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034540715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034540716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034540716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034540716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034540717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:42.079628 run osmo-stp_10.42.42.5(pid=22550): stdout: | (launched: 2022-12-10_03:45:40.543611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:42.198040 run osmo-stp_10.42.42.5(pid=22550): stderr: | 20221210034540714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034540714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034540715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034540716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034540716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034540716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034540717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:42.339894 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22550): Process ended prematurely: osmo-stp_10.42.42.5(pid=22550) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22550)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:45:42.349054 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:45:42.375821 run osmo-hlr_10.42.42.2(pid=22547): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22547)] 03:45:42.423877 run osmo-hlr_10.42.42.2(pid=22547): stdout: | (launched: 2022-12-10_03:45:39.614164) 03:45:42.472783 run osmo-hlr_10.42.42.2(pid=22547): stderr: | 20221210034539790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034539790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034539790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034539790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034539790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034539790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034539804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034539814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034539814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034539814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:42.541143 run osmo-msc_10.42.42.6(pid=22553): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22553)] 03:45:42.588135 run osmo-msc_10.42.42.6(pid=22553): stdout: | (launched: 2022-12-10_03:45:41.483458) 03:45:42.636809 run osmo-msc_10.42.42.6(pid=22553): stderr: | 20221210034541758 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034541758 DLGLOBAL DEBUG validating counter group 0x7f2560496c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034541758 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034541758 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034541759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034541759 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034541761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034541761 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034541761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034541762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:42.685816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22546): Terminating (SIGTERM) 03:45:42.725244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22549): Terminating (SIGTERM) 03:45:42.764475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22552): Terminating (SIGTERM) 03:45:42.804093 --- ParallelTerminationStrategy: PID 22546 died... 03:45:42.822817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22546): Terminated: ok {rc=0} 03:45:42.866843 --- ParallelTerminationStrategy: PID 22549 died... 03:45:42.885188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22549): Terminated: ok {rc=0} 03:45:42.928660 --- ParallelTerminationStrategy: PID 22552 died... 03:45:42.947004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22552): Terminated: ok {rc=0} 03:45:43.032015 bus /sierra_3: Setting Powered False 03:45:44.127079 bus /sierra_3: Setting Powered False 03:45:45.241131 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:45:46.414580 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:46.430702 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:45:46.501193 tst mo_mt_call_osmux.py: using LAC 25762 03:45:46.662553 tst mo_mt_call_osmux.py: using RAC 7 03:45:46.783488 tst mo_mt_call_osmux.py: using CellId 25762 03:45:46.903063 tst mo_mt_call_osmux.py: using BVCI 25763 03:45:47.019935 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:47.032554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:47.044671 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:47.056852 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:47.068724 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:45:47.080628 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:45:47.214878 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:45:47.342417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:47.834884 run create_hlr_db(pid=22555): Launched 03:45:47.963212 bus /sierra_2: Setting Powered False 03:45:49.026892 run create_hlr_db(pid=22555): Terminated: ok {rc=0} 03:45:49.466911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22557): Launched 03:45:49.782128 run osmo-hlr_10.42.42.2(pid=22558): Launched 03:45:49.902353 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:50.446224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22560): Launched 03:45:50.762057 run osmo-stp_10.42.42.5(pid=22561): Launched 03:45:50.882288 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:51.453516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22563): Launched 03:45:51.769286 run osmo-msc_10.42.42.6(pid=22564): Launched 03:45:51.946273 run osmo-stp_10.42.42.5(pid=22561): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22561)] 03:45:52.079502 run osmo-stp_10.42.42.5(pid=22561): stdout: | (launched: 2022-12-10_03:45:50.704113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:52.212902 run osmo-stp_10.42.42.5(pid=22561): stderr: | 20221210034550896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034550897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034550897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034550897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034550898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034550898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034550898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:52.345686 run osmo-stp_10.42.42.5(pid=22561): stdout: | (launched: 2022-12-10_03:45:50.704113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:52.471538 run osmo-stp_10.42.42.5(pid=22561): stderr: | 20221210034550896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034550897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034550897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034550897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034550898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034550898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034550898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:52.621532 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22561): Process ended prematurely: osmo-stp_10.42.42.5(pid=22561) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22561)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:45:52.631038 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:45:52.658553 run osmo-hlr_10.42.42.2(pid=22558): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22558)] 03:45:52.708197 run osmo-hlr_10.42.42.2(pid=22558): stdout: | (launched: 2022-12-10_03:45:49.724752) 03:45:52.758848 run osmo-hlr_10.42.42.2(pid=22558): stderr: | 20221210034549922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034549922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034549922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034549922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034549922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034549922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034549935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034549945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034549945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034549945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:52.829772 run osmo-msc_10.42.42.6(pid=22564): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22564)] 03:45:52.878853 run osmo-msc_10.42.42.6(pid=22564): stdout: | (launched: 2022-12-10_03:45:51.711630) 03:45:52.930162 run osmo-msc_10.42.42.6(pid=22564): stderr: | 20221210034552034 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034552034 DLGLOBAL DEBUG validating counter group 0x7f17e7f6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034552034 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034552034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034552034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034552035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034552036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034552037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034552037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034552037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:52.981198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22557): Terminating (SIGTERM) 03:45:53.021935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22560): Terminating (SIGTERM) 03:45:53.062821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22563): Terminating (SIGTERM) 03:45:53.103881 --- ParallelTerminationStrategy: PID 22557 died... 03:45:53.123613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22557): Terminated: ok {rc=0} 03:45:53.168844 --- ParallelTerminationStrategy: PID 22560 died... 03:45:53.188650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22560): Terminated: ok {rc=0} 03:45:53.233859 --- ParallelTerminationStrategy: PID 22563 died... 03:45:53.252931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22563): Terminated: ok {rc=0} 03:45:53.338453 bus /sierra_3: Setting Powered False 03:45:54.434179 bus /sierra_3: Setting Powered False 03:45:55.548863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:45:56.782788 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:56.789672 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:45:56.810779 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:45:56.838115 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:45:56.891331 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:45:56.912671 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:45:56.940451 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:45:57.491494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:45:57.542225 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:45:57.553748 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:45:57.616109 tst mo_mt_call.py: using LAC 25763 03:45:57.739436 tst mo_mt_call.py: using RAC 8 03:45:57.865782 tst mo_mt_call.py: using CellId 25763 03:45:57.988660 tst mo_mt_call.py: using BVCI 25764 03:45:58.104783 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:45:58.116296 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:45:58.127564 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:45:58.138804 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:45:58.150079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:45:58.161339 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:45:58.273494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:45:58.390445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:58.879807 run create_hlr_db(pid=22569): Launched 03:45:59.007998 bus /sierra_2: Setting Powered False 03:46:00.071302 run create_hlr_db(pid=22569): Terminated: ok {rc=0} 03:46:00.492842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22571): Launched 03:46:00.789028 run osmo-hlr_10.42.42.2(pid=22572): Launched 03:46:01.014763 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:01.664417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22574): Launched 03:46:02.010227 run osmo-stp_10.42.42.5(pid=22575): Launched 03:46:02.257802 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:02.791407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22577): Launched 03:46:03.087727 run osmo-msc_10.42.42.6(pid=22578): Launched 03:46:03.254264 run osmo-stp_10.42.42.5(pid=22575): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22575)] 03:46:03.379744 run osmo-stp_10.42.42.5(pid=22575): stdout: | (launched: 2022-12-10_03:46:01.941566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:03.505642 run osmo-stp_10.42.42.5(pid=22575): stderr: | 20221210034602207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034602207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034602207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034602207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034602208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034602208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034602208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:03.628900 run osmo-stp_10.42.42.5(pid=22575): stdout: | (launched: 2022-12-10_03:46:01.941566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:03.747131 run osmo-stp_10.42.42.5(pid=22575): stderr: | 20221210034602207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034602207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034602207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034602207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034602208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034602208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034602208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:03.888274 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22575): Process ended prematurely: osmo-stp_10.42.42.5(pid=22575) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22575)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:46:03.897719 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:46:03.924540 run osmo-hlr_10.42.42.2(pid=22572): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22572)] 03:46:03.971852 run osmo-hlr_10.42.42.2(pid=22572): stdout: | (launched: 2022-12-10_03:46:00.734753) 03:46:04.020935 run osmo-hlr_10.42.42.2(pid=22572): stderr: | 20221210034600981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034600981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034600981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034600981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034600981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034600981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034601001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034601017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034601017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034601017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:04.089043 run osmo-msc_10.42.42.6(pid=22578): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22578)] 03:46:04.136207 run osmo-msc_10.42.42.6(pid=22578): stdout: | (launched: 2022-12-10_03:46:03.033169) 03:46:04.185228 run osmo-msc_10.42.42.6(pid=22578): stderr: | 20221210034603303 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034603304 DLGLOBAL DEBUG validating counter group 0x7fd41e1cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034603304 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034603304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034603304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034603304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034603306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034603307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034603307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034603307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:04.234413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22571): Terminating (SIGTERM) 03:46:04.273694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22574): Terminating (SIGTERM) 03:46:04.312904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22577): Terminating (SIGTERM) 03:46:04.352406 --- ParallelTerminationStrategy: PID 22571 died... 03:46:04.371315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22571): Terminated: ok {rc=0} 03:46:04.415091 --- ParallelTerminationStrategy: PID 22574 died... 03:46:04.433749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22574): Terminated: ok {rc=0} 03:46:04.478289 --- ParallelTerminationStrategy: PID 22577 died... 03:46:04.496714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22577): Terminated: ok {rc=0} 03:46:04.582102 bus /sierra_3: Setting Powered False 03:46:05.680936 bus /sierra_3: Setting Powered False 03:46:06.794504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:46:07.941614 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:07.953618 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:46:08.011656 tst mo_mt_call_osmux.py: using LAC 25764 03:46:08.130015 tst mo_mt_call_osmux.py: using RAC 9 03:46:08.246595 tst mo_mt_call_osmux.py: using CellId 25764 03:46:08.365814 tst mo_mt_call_osmux.py: using BVCI 25765 03:46:08.474631 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:08.485927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:08.496611 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:08.507569 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:08.518606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:08.529675 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:08.645523 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:08.763316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:09.253711 run create_hlr_db(pid=22580): Launched 03:46:09.381970 bus /sierra_2: Setting Powered False 03:46:10.444605 run create_hlr_db(pid=22580): Terminated: ok {rc=0} 03:46:10.868786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22582): Launched 03:46:11.165705 run osmo-hlr_10.42.42.2(pid=22583): Launched 03:46:11.278114 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:11.786566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22585): Launched 03:46:12.081931 run osmo-stp_10.42.42.5(pid=22586): Launched 03:46:12.193960 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:12.727791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22588): Launched 03:46:13.023637 run osmo-msc_10.42.42.6(pid=22589): Launched 03:46:13.188811 run osmo-stp_10.42.42.5(pid=22586): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22586)] 03:46:13.323239 run osmo-stp_10.42.42.5(pid=22586): stdout: | (launched: 2022-12-10_03:46:12.027599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:13.458202 run osmo-stp_10.42.42.5(pid=22586): stderr: | 20221210034612198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034612198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034612198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034612199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034612199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034612199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034612199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:13.589906 run osmo-stp_10.42.42.5(pid=22586): stdout: | (launched: 2022-12-10_03:46:12.027599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:13.715840 run osmo-stp_10.42.42.5(pid=22586): stderr: | 20221210034612198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034612198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034612198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034612199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034612199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034612199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034612199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:13.866498 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22586): Process ended prematurely: osmo-stp_10.42.42.5(pid=22586) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22586)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:46:13.875943 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:46:13.903569 run osmo-hlr_10.42.42.2(pid=22583): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22583)] 03:46:13.953380 run osmo-hlr_10.42.42.2(pid=22583): stdout: | (launched: 2022-12-10_03:46:11.111125) 03:46:14.004772 run osmo-hlr_10.42.42.2(pid=22583): stderr: | 20221210034611287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034611287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034611287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034611287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034611287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034611287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034611301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034611310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034611311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034611311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:14.075703 run osmo-msc_10.42.42.6(pid=22589): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22589)] 03:46:14.124864 run osmo-msc_10.42.42.6(pid=22589): stdout: | (launched: 2022-12-10_03:46:12.969351) 03:46:14.175544 run osmo-msc_10.42.42.6(pid=22589): stderr: | 20221210034613241 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034613241 DLGLOBAL DEBUG validating counter group 0x7f91b1ffac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034613241 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034613241 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034613241 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034613241 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034613243 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034613243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034613244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034613244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:14.226801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22582): Terminating (SIGTERM) 03:46:14.267590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22585): Terminating (SIGTERM) 03:46:14.308391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22588): Terminating (SIGTERM) 03:46:14.350558 --- ParallelTerminationStrategy: PID 22582 died... 03:46:14.370213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22582): Terminated: ok {rc=0} 03:46:14.415836 --- ParallelTerminationStrategy: PID 22585 died... 03:46:14.435128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22585): Terminated: ok {rc=0} 03:46:14.480769 --- ParallelTerminationStrategy: PID 22588 died... 03:46:14.500273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22588): Terminated: ok {rc=0} 03:46:14.586830 bus /sierra_3: Setting Powered False 03:46:15.684704 bus /sierra_3: Setting Powered False 03:46:16.808898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:46:18.040437 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:46:18.046711 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:46:18.067547 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:46:18.094134 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:46:18.146095 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:46:18.166667 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:46:18.192784 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:46:18.741855 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:46:18.789365 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:18.800385 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:46:18.855752 tst mo_mt_call.py: using LAC 25765 03:46:18.970973 tst mo_mt_call.py: using RAC 10 03:46:19.091746 tst mo_mt_call.py: using CellId 25765 03:46:19.219016 tst mo_mt_call.py: using BVCI 25766 03:46:19.335436 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:19.347171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:19.358606 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:19.370218 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:19.381874 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:19.393713 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:19.506347 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:19.622489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:20.080604 run create_hlr_db(pid=22594): Launched 03:46:20.194520 bus /sierra_2: Setting Powered False 03:46:21.253965 run create_hlr_db(pid=22594): Terminated: ok {rc=0} 03:46:21.686440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22596): Launched 03:46:22.002928 run osmo-hlr_10.42.42.2(pid=22597): Launched 03:46:22.123910 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:22.672655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22599): Launched 03:46:22.989158 run osmo-stp_10.42.42.5(pid=22600): Launched 03:46:23.109984 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:23.682104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22602): Launched 03:46:23.997969 run osmo-msc_10.42.42.6(pid=22603): Launched 03:46:24.174050 run osmo-stp_10.42.42.5(pid=22600): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22600)] 03:46:24.307339 run osmo-stp_10.42.42.5(pid=22600): stdout: | (launched: 2022-12-10_03:46:22.930887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:24.441158 run osmo-stp_10.42.42.5(pid=22600): stderr: | 20221210034623123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034623123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034623123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034623123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034623126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034623126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034623126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:24.574346 run osmo-stp_10.42.42.5(pid=22600): stdout: | (launched: 2022-12-10_03:46:22.930887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:24.700742 run osmo-stp_10.42.42.5(pid=22600): stderr: | 20221210034623123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034623123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034623123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034623123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034623126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034623126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034623126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:24.851555 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22600): Process ended prematurely: osmo-stp_10.42.42.5(pid=22600) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22600)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:46:24.861281 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:46:24.888999 run osmo-hlr_10.42.42.2(pid=22597): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22597)] 03:46:24.938423 run osmo-hlr_10.42.42.2(pid=22597): stdout: | (launched: 2022-12-10_03:46:21.944909) 03:46:24.989599 run osmo-hlr_10.42.42.2(pid=22597): stderr: | 20221210034622142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034622142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034622142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034622142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034622142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034622142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034622155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034622163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034622163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034622163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:25.060532 run osmo-msc_10.42.42.6(pid=22603): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22603)] 03:46:25.109695 run osmo-msc_10.42.42.6(pid=22603): stdout: | (launched: 2022-12-10_03:46:23.939747) 03:46:25.160322 run osmo-msc_10.42.42.6(pid=22603): stderr: | 20221210034624261 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034624261 DLGLOBAL DEBUG validating counter group 0x7f2ee58cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034624261 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034624261 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034624261 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034624261 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034624263 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034624263 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034624264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034624264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:25.211398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22596): Terminating (SIGTERM) 03:46:25.252434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22599): Terminating (SIGTERM) 03:46:25.293451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22602): Terminating (SIGTERM) 03:46:25.334733 --- ParallelTerminationStrategy: PID 22596 died... 03:46:25.354468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22596): Terminated: ok {rc=0} 03:46:25.399956 --- ParallelTerminationStrategy: PID 22599 died... 03:46:25.419300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22599): Terminated: ok {rc=0} 03:46:25.464430 --- ParallelTerminationStrategy: PID 22602 died... 03:46:25.483564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22602): Terminated: ok {rc=0} 03:46:25.569748 bus /sierra_3: Setting Powered False 03:46:26.666646 bus /sierra_3: Setting Powered False 03:46:27.780570 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:46:28.926978 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:28.939182 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:46:28.998566 tst mo_mt_call_osmux.py: using LAC 25766 03:46:29.124497 tst mo_mt_call_osmux.py: using RAC 11 03:46:29.250366 tst mo_mt_call_osmux.py: using CellId 25766 03:46:29.375812 tst mo_mt_call_osmux.py: using BVCI 25767 03:46:29.490413 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:29.501815 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:29.512881 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:29.524382 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:29.535763 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:29.547101 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:29.661192 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:29.775205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:30.232192 run create_hlr_db(pid=22605): Launched 03:46:30.345435 bus /sierra_2: Setting Powered False 03:46:31.407991 run create_hlr_db(pid=22605): Terminated: ok {rc=0} 03:46:31.888996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Launched 03:46:32.261800 run osmo-hlr_10.42.42.2(pid=22608): Launched 03:46:32.375177 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:32.895640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Launched 03:46:33.190967 run osmo-stp_10.42.42.5(pid=22611): Launched 03:46:33.303223 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:33.838151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22613): Launched 03:46:34.134534 run osmo-msc_10.42.42.6(pid=22614): Launched 03:46:34.299493 run osmo-stp_10.42.42.5(pid=22611): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] 03:46:34.425142 run osmo-stp_10.42.42.5(pid=22611): stdout: | (launched: 2022-12-10_03:46:33.136718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:34.550708 run osmo-stp_10.42.42.5(pid=22611): stderr: | 20221210034633304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034633304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034633304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034633305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034633307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034633307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034633307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:34.674513 run osmo-stp_10.42.42.5(pid=22611): stdout: | (launched: 2022-12-10_03:46:33.136718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:34.792460 run osmo-stp_10.42.42.5(pid=22611): stderr: | 20221210034633304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034633304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034633304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034633305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034633307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034633307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034633307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:34.933520 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22611): Process ended prematurely: osmo-stp_10.42.42.5(pid=22611) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:46:34.942440 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:46:34.969225 run osmo-hlr_10.42.42.2(pid=22608): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22608)] 03:46:35.016004 run osmo-hlr_10.42.42.2(pid=22608): stdout: | (launched: 2022-12-10_03:46:32.206355) 03:46:35.064567 run osmo-hlr_10.42.42.2(pid=22608): stderr: | 20221210034632382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034632382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034632382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034632382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034632382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034632382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034632394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034632403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034632403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034632403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:35.132529 run osmo-msc_10.42.42.6(pid=22614): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22614)] 03:46:35.179396 run osmo-msc_10.42.42.6(pid=22614): stdout: | (launched: 2022-12-10_03:46:34.079571) 03:46:35.228065 run osmo-msc_10.42.42.6(pid=22614): stderr: | 20221210034634351 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034634351 DLGLOBAL DEBUG validating counter group 0x7f5143422c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034634351 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034634351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034634351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034634351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034634353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034634354 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034634354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034634354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:35.277142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Terminating (SIGTERM) 03:46:35.316007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Terminating (SIGTERM) 03:46:35.355188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22613): Terminating (SIGTERM) 03:46:35.394496 --- ParallelTerminationStrategy: PID 22607 died... 03:46:35.413239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Terminated: ok {rc=0} 03:46:35.456760 --- ParallelTerminationStrategy: PID 22610 died... 03:46:35.475075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Terminated: ok {rc=0} 03:46:35.518424 --- ParallelTerminationStrategy: PID 22613 died... 03:46:35.536860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22613): Terminated: ok {rc=0} 03:46:35.620582 bus /sierra_3: Setting Powered False 03:46:36.718704 bus /sierra_3: Setting Powered False 03:46:37.833789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:46:39.066897 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:46:39.073894 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:46:39.095060 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:46:39.122367 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:46:39.175131 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:46:39.196026 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:46:39.223127 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:46:39.775136 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:46:39.825469 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:39.836757 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:46:39.897351 tst mo_mt_call.py: using LAC 25767 03:46:40.020835 tst mo_mt_call.py: using RAC 12 03:46:40.142974 tst mo_mt_call.py: using CellId 25767 03:46:40.264860 tst mo_mt_call.py: using BVCI 25768 03:46:40.379246 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:40.390684 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:40.401906 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:40.413129 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:40.424259 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:40.435485 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:46:40.549118 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:46:40.662623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:41.123215 run create_hlr_db(pid=22620): Launched 03:46:41.235887 bus /sierra_2: Setting Powered False 03:46:42.295438 run create_hlr_db(pid=22620): Terminated: ok {rc=0} 03:46:42.707944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22622): Launched 03:46:43.003880 run osmo-hlr_10.42.42.2(pid=22623): Launched 03:46:43.117252 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:43.625423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22625): Launched 03:46:43.921793 run osmo-stp_10.42.42.5(pid=22626): Launched 03:46:44.034650 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:44.570136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22628): Launched 03:46:44.866686 run osmo-msc_10.42.42.6(pid=22629): Launched 03:46:45.032267 run osmo-stp_10.42.42.5(pid=22626): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22626)] 03:46:45.158258 run osmo-stp_10.42.42.5(pid=22626): stdout: | (launched: 2022-12-10_03:46:43.866355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:45.284207 run osmo-stp_10.42.42.5(pid=22626): stderr: | 20221210034644037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034644037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034644037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034644038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034644038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034644038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034644038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:45.408043 run osmo-stp_10.42.42.5(pid=22626): stdout: | (launched: 2022-12-10_03:46:43.866355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:45.526027 run osmo-stp_10.42.42.5(pid=22626): stderr: | 20221210034644037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034644037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034644037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034644038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034644038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034644038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034644038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:45.667554 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22626): Process ended prematurely: osmo-stp_10.42.42.5(pid=22626) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22626)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:46:45.676653 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 03:46:45.703566 run osmo-hlr_10.42.42.2(pid=22623): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22623)] 03:46:45.750695 run osmo-hlr_10.42.42.2(pid=22623): stdout: | (launched: 2022-12-10_03:46:42.949447) 03:46:45.799293 run osmo-hlr_10.42.42.2(pid=22623): stderr: | 20221210034643127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034643127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034643127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034643127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034643127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034643127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034643143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034643153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034643154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034643154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:45.887137 run osmo-msc_10.42.42.6(pid=22629): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22629)] 03:46:45.958400 run osmo-msc_10.42.42.6(pid=22629): stdout: | (launched: 2022-12-10_03:46:44.812148) 03:46:46.015513 run osmo-msc_10.42.42.6(pid=22629): stderr: | 20221210034645084 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034645084 DLGLOBAL DEBUG validating counter group 0x7fc5662c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034645085 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034645085 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034645085 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034645085 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034645087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034645087 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034645087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034645087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:46.069273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22622): Terminating (SIGTERM) 03:46:46.113317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22625): Terminating (SIGTERM) 03:46:46.159971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22628): Terminating (SIGTERM) 03:46:46.205935 --- ParallelTerminationStrategy: PID 22622 died... 03:46:46.226404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22622): Terminated: ok {rc=0} 03:46:46.280610 --- ParallelTerminationStrategy: PID 22625 died... 03:46:46.304410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22625): Terminated: ok {rc=0} 03:46:46.357858 --- ParallelTerminationStrategy: PID 22628 died... 03:46:46.380817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22628): Terminated: ok {rc=0} 03:46:46.484301 bus /sierra_3: Setting Powered False 03:46:47.593000 bus /sierra_3: Setting Powered False 03:46:48.705420 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:46:49.849492 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:49.861108 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:46:49.917590 tst mo_mt_call_osmux.py: using LAC 25768 03:46:50.043768 tst mo_mt_call_osmux.py: using RAC 13 03:46:50.167806 tst mo_mt_call_osmux.py: using CellId 25768 03:46:50.293994 tst mo_mt_call_osmux.py: using BVCI 25769 03:46:50.409085 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:50.421121 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:50.432495 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:50.443737 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:50.455207 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:46:50.466791 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:46:50.579953 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:46:50.693571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:51.154239 run create_hlr_db(pid=22631): Launched 03:46:51.267966 bus /sierra_2: Setting Powered False 03:46:52.327116 run create_hlr_db(pid=22631): Terminated: ok {rc=0} 03:46:52.760559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22633): Launched 03:46:53.078914 run osmo-hlr_10.42.42.2(pid=22634): Launched 03:46:53.199824 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:53.746351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22636): Launched 03:46:54.063794 run osmo-stp_10.42.42.5(pid=22637): Launched 03:46:54.184712 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:54.758874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22639): Launched 03:46:55.077104 run osmo-msc_10.42.42.6(pid=22640): Launched 03:46:55.253252 run osmo-stp_10.42.42.5(pid=22637): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22637)] 03:46:55.386751 run osmo-stp_10.42.42.5(pid=22637): stdout: | (launched: 2022-12-10_03:46:54.005741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:55.520492 run osmo-stp_10.42.42.5(pid=22637): stderr: | 20221210034654198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034654199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034654199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034654199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034654200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034654200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034654200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:55.654067 run osmo-stp_10.42.42.5(pid=22637): stdout: | (launched: 2022-12-10_03:46:54.005741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:55.779948 run osmo-stp_10.42.42.5(pid=22637): stderr: | 20221210034654198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034654199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034654199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034654199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034654200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034654200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034654200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:55.930774 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22637): Process ended prematurely: osmo-stp_10.42.42.5(pid=22637) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22637)] [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:46:55.940428 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:46:55.968570 run osmo-hlr_10.42.42.2(pid=22634): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22634)] 03:46:56.018387 run osmo-hlr_10.42.42.2(pid=22634): stdout: | (launched: 2022-12-10_03:46:53.020702) 03:46:56.069600 run osmo-hlr_10.42.42.2(pid=22634): stderr: | 20221210034653219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034653219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034653219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034653219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034653219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034653219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034653232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034653240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034653240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034653240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:56.141509 run osmo-msc_10.42.42.6(pid=22640): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22640)] 03:46:56.191238 run osmo-msc_10.42.42.6(pid=22640): stdout: | (launched: 2022-12-10_03:46:55.018791) 03:46:56.242449 run osmo-msc_10.42.42.6(pid=22640): stderr: | 20221210034655343 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034655344 DLGLOBAL DEBUG validating counter group 0x7fdb9def6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034655344 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034655344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034655344 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034655344 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034655346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034655346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034655347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034655347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:56.294034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22633): Terminating (SIGTERM) 03:46:56.335412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22636): Terminating (SIGTERM) 03:46:56.376783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22639): Terminating (SIGTERM) 03:46:56.418739 --- ParallelTerminationStrategy: PID 22633 died... 03:46:56.438414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22633): Terminated: ok {rc=0} 03:46:56.484695 --- ParallelTerminationStrategy: PID 22636 died... 03:46:56.504215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22636): Terminated: ok {rc=0} 03:46:56.550291 --- ParallelTerminationStrategy: PID 22639 died... 03:46:56.569844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22639): Terminated: ok {rc=0} 03:46:56.656774 bus /sierra_3: Setting Powered False 03:46:57.753528 bus /sierra_3: Setting Powered False 03:46:58.867666 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:47:00.105514 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:00.112192 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:47:00.133002 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:47:00.160766 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:47:00.214562 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:47:00.235200 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:47:00.261675 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:47:00.813647 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:47:00.873867 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:00.888205 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:47:00.947413 tst mo_mt_call.py: using LAC 25769 03:47:01.074329 tst mo_mt_call.py: using RAC 14 03:47:01.200528 tst mo_mt_call.py: using CellId 25769 03:47:01.325297 tst mo_mt_call.py: using BVCI 25770 03:47:01.438070 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:01.450378 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:01.462483 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:01.476680 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:01.488555 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:01.501663 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:01.623123 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:01.763606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:02.272355 run create_hlr_db(pid=22645): Launched 03:47:02.432150 bus /sierra_2: Setting Powered False 03:47:03.495760 run create_hlr_db(pid=22645): Terminated: ok {rc=0} 03:47:03.918890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22647): Launched 03:47:04.214992 run osmo-hlr_10.42.42.2(pid=22648): Launched 03:47:04.327197 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:04.839740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22650): Launched 03:47:05.136049 run osmo-stp_10.42.42.5(pid=22651): Launched 03:47:05.247813 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:05.783314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22653): Launched 03:47:06.080186 run osmo-msc_10.42.42.6(pid=22654): Launched 03:47:06.245902 run osmo-stp_10.42.42.5(pid=22651): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22651)] 03:47:06.370872 run osmo-stp_10.42.42.5(pid=22651): stdout: | (launched: 2022-12-10_03:47:05.081509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:06.496744 run osmo-stp_10.42.42.5(pid=22651): stderr: | 20221210034705254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034705254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034705254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034705254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034705255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034705255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034705255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:06.620693 run osmo-stp_10.42.42.5(pid=22651): stdout: | (launched: 2022-12-10_03:47:05.081509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:06.738981 run osmo-stp_10.42.42.5(pid=22651): stderr: | 20221210034705254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034705254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034705254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034705254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034705255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034705255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034705255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:06.880452 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22651): Process ended prematurely: osmo-stp_10.42.42.5(pid=22651) [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22651)] [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:47:06.889614 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:47:06.916756 run osmo-hlr_10.42.42.2(pid=22648): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22648)] 03:47:06.964390 run osmo-hlr_10.42.42.2(pid=22648): stdout: | (launched: 2022-12-10_03:47:04.160640) 03:47:07.013521 run osmo-hlr_10.42.42.2(pid=22648): stderr: | 20221210034704335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034704335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034704335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034704335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034704335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034704336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034704347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034704356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034704356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034704356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:07.081740 run osmo-msc_10.42.42.6(pid=22654): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22654)] 03:47:07.128830 run osmo-msc_10.42.42.6(pid=22654): stdout: | (launched: 2022-12-10_03:47:06.025588) 03:47:07.177547 run osmo-msc_10.42.42.6(pid=22654): stderr: | 20221210034706298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034706298 DLGLOBAL DEBUG validating counter group 0x7f596fe04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034706298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034706298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034706299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034706299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034706301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034706301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034706301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034706301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:07.226955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22647): Terminating (SIGTERM) 03:47:07.266415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22650): Terminating (SIGTERM) 03:47:07.305839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22653): Terminating (SIGTERM) 03:47:07.345655 --- ParallelTerminationStrategy: PID 22647 died... 03:47:07.364518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22647): Terminated: ok {rc=0} 03:47:07.408670 --- ParallelTerminationStrategy: PID 22650 died... 03:47:07.427170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22650): Terminated: ok {rc=0} 03:47:07.471920 --- ParallelTerminationStrategy: PID 22653 died... 03:47:07.490470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22653): Terminated: ok {rc=0} 03:47:07.575349 bus /sierra_3: Setting Powered False 03:47:08.671680 bus /sierra_3: Setting Powered False 03:47:09.784751 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:47:10.927933 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:10.939722 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:47:10.996777 tst mo_mt_call_osmux.py: using LAC 25770 03:47:11.114527 tst mo_mt_call_osmux.py: using RAC 15 03:47:11.230745 tst mo_mt_call_osmux.py: using CellId 25770 03:47:11.347100 tst mo_mt_call_osmux.py: using BVCI 25771 03:47:11.457129 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:11.468228 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:11.478958 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:11.490153 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:11.501450 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:11.512528 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:11.628158 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:11.747375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:12.241281 run create_hlr_db(pid=22656): Launched 03:47:12.370705 bus /sierra_2: Setting Powered False 03:47:13.434271 run create_hlr_db(pid=22656): Terminated: ok {rc=0} 03:47:13.858217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22658): Launched 03:47:14.155295 run osmo-hlr_10.42.42.2(pid=22659): Launched 03:47:14.267678 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:14.791741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22661): Launched 03:47:15.089800 run osmo-stp_10.42.42.5(pid=22662): Launched 03:47:15.202865 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:15.738300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22664): Launched 03:47:16.090871 run osmo-msc_10.42.42.6(pid=22665): Launched 03:47:16.458178 run osmo-stp_10.42.42.5(pid=22662): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22662)] 03:47:16.776350 run osmo-stp_10.42.42.5(pid=22662): stdout: | (launched: 2022-12-10_03:47:15.034916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:17.085741 run osmo-stp_10.42.42.5(pid=22662): stderr: | 20221210034715206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034715207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034715207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034715207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034715208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034715208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034715208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:17.250601 run osmo-stp_10.42.42.5(pid=22662): stdout: | (launched: 2022-12-10_03:47:15.034916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:17.379098 run osmo-stp_10.42.42.5(pid=22662): stderr: | 20221210034715206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034715207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034715207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034715207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034715208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034715208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034715208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:17.530701 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22662): Process ended prematurely: osmo-stp_10.42.42.5(pid=22662) [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22662)] [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:47:17.540186 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:47:17.568035 run osmo-hlr_10.42.42.2(pid=22659): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22659)] 03:47:17.617573 run osmo-hlr_10.42.42.2(pid=22659): stdout: | (launched: 2022-12-10_03:47:14.100937) 03:47:17.668605 run osmo-hlr_10.42.42.2(pid=22659): stderr: | 20221210034714275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034714275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034714275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034714275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034714275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034714275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034714287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034714296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034714296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034714296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:17.740074 run osmo-msc_10.42.42.6(pid=22665): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22665)] 03:47:17.789363 run osmo-msc_10.42.42.6(pid=22665): stdout: | (launched: 2022-12-10_03:47:16.018136) 03:47:17.840651 run osmo-msc_10.42.42.6(pid=22665): stderr: | 20221210034716521 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034716522 DLGLOBAL DEBUG validating counter group 0x7f1c99338c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034716523 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034716523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034716523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034716523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034716526 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034716528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034716529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034716529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:17.892073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22658): Terminating (SIGTERM) 03:47:17.933397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22661): Terminating (SIGTERM) 03:47:17.974938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22664): Terminating (SIGTERM) 03:47:18.016496 --- ParallelTerminationStrategy: PID 22658 died... 03:47:18.036525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22658): Terminated: ok {rc=0} 03:47:18.082160 --- ParallelTerminationStrategy: PID 22661 died... 03:47:18.101603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22661): Terminated: ok {rc=0} 03:47:18.147644 --- ParallelTerminationStrategy: PID 22664 died... 03:47:18.166926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22664): Terminated: ok {rc=0} 03:47:18.253322 bus /sierra_3: Setting Powered False 03:47:19.350237 bus /sierra_3: Setting Powered False 03:47:20.463997 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:47:21.690524 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:21.695974 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:47:21.716873 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:47:21.744107 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:47:21.795755 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:47:21.816203 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:47:21.842783 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:47:22.390645 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:47:22.438622 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:22.449667 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:47:22.505555 tst mo_mt_call.py: using LAC 25771 03:47:22.622254 tst mo_mt_call.py: using RAC 16 03:47:22.740477 tst mo_mt_call.py: using CellId 25771 03:47:22.856145 tst mo_mt_call.py: using BVCI 25772 03:47:22.963346 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:22.974242 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:22.984693 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:22.995424 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:23.006215 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:23.017052 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:23.133159 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:23.249894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:23.741960 run create_hlr_db(pid=22670): Launched 03:47:23.870104 bus /sierra_2: Setting Powered False 03:47:24.933503 run create_hlr_db(pid=22670): Terminated: ok {rc=0} 03:47:25.358470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22672): Launched 03:47:25.655145 run osmo-hlr_10.42.42.2(pid=22673): Launched 03:47:25.770502 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:26.292691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22675): Launched 03:47:26.589898 run osmo-stp_10.42.42.5(pid=22676): Launched 03:47:26.705270 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:27.243183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22678): Launched 03:47:27.539571 run osmo-msc_10.42.42.6(pid=22679): Launched 03:47:27.706483 run osmo-stp_10.42.42.5(pid=22676): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22676)] 03:47:27.832676 run osmo-stp_10.42.42.5(pid=22676): stdout: | (launched: 2022-12-10_03:47:26.535460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:27.958514 run osmo-stp_10.42.42.5(pid=22676): stderr: | 20221210034726702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034726702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034726702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034726703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034726705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034726705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034726705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:28.082859 run osmo-stp_10.42.42.5(pid=22676): stdout: | (launched: 2022-12-10_03:47:26.535460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:28.201317 run osmo-stp_10.42.42.5(pid=22676): stderr: | 20221210034726702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034726702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034726702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034726703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034726705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034726705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034726705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:28.342621 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22676): Process ended prematurely: osmo-stp_10.42.42.5(pid=22676) [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22676)] [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:47:28.351522 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 03:47:28.378288 run osmo-hlr_10.42.42.2(pid=22673): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22673)] 03:47:28.425647 run osmo-hlr_10.42.42.2(pid=22673): stdout: | (launched: 2022-12-10_03:47:25.600708) 03:47:28.474773 run osmo-hlr_10.42.42.2(pid=22673): stderr: | 20221210034725774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034725774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034725774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034725774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034725774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034725774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034725785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034725794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034725794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034725794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:28.543331 run osmo-msc_10.42.42.6(pid=22679): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22679)] 03:47:28.590758 run osmo-msc_10.42.42.6(pid=22679): stdout: | (launched: 2022-12-10_03:47:27.484423) 03:47:28.639902 run osmo-msc_10.42.42.6(pid=22679): stderr: | 20221210034727754 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034727754 DLGLOBAL DEBUG validating counter group 0x7ff7bff82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034727754 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034727754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034727755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034727755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034727757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034727757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034727758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034727758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:28.689326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22672): Terminating (SIGTERM) 03:47:28.728669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22675): Terminating (SIGTERM) 03:47:28.767998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22678): Terminating (SIGTERM) 03:47:28.807622 --- ParallelTerminationStrategy: PID 22672 died... 03:47:28.826653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22672): Terminated: ok {rc=0} 03:47:28.870815 --- ParallelTerminationStrategy: PID 22675 died... 03:47:28.889390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22675): Terminated: ok {rc=0} 03:47:28.933255 --- ParallelTerminationStrategy: PID 22678 died... 03:47:28.951510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22678): Terminated: ok {rc=0} 03:47:29.036616 bus /sierra_3: Setting Powered False 03:47:30.136849 bus /sierra_3: Setting Powered False 03:47:31.264737 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:47:32.425716 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:32.437483 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:47:32.496233 tst mo_mt_call_osmux.py: using LAC 25772 03:47:32.615107 tst mo_mt_call_osmux.py: using RAC 17 03:47:32.739846 tst mo_mt_call_osmux.py: using CellId 25772 03:47:32.856317 tst mo_mt_call_osmux.py: using BVCI 25773 03:47:32.963451 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:32.974395 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:32.984862 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:32.995714 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:33.006615 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:33.017540 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:33.132148 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:33.249116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:33.709476 run create_hlr_db(pid=22681): Launched 03:47:33.821582 bus /sierra_2: Setting Powered False 03:47:34.881432 run create_hlr_db(pid=22681): Terminated: ok {rc=0} 03:47:35.316792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22683): Launched 03:47:35.634874 run osmo-hlr_10.42.42.2(pid=22684): Launched 03:47:35.757239 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:36.306628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22686): Launched 03:47:36.623105 run osmo-stp_10.42.42.5(pid=22687): Launched 03:47:36.745638 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:37.325303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22689): Launched 03:47:37.642988 run osmo-msc_10.42.42.6(pid=22690): Launched 03:47:37.820300 run osmo-stp_10.42.42.5(pid=22687): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22687)] 03:47:37.957950 run osmo-stp_10.42.42.5(pid=22687): stdout: | (launched: 2022-12-10_03:47:36.564890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:38.092749 run osmo-stp_10.42.42.5(pid=22687): stderr: | 20221210034736756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034736757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034736757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034736757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034736758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034736758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034736758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:38.225552 run osmo-stp_10.42.42.5(pid=22687): stdout: | (launched: 2022-12-10_03:47:36.564890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:38.351654 run osmo-stp_10.42.42.5(pid=22687): stderr: | 20221210034736756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034736757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034736757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034736757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034736758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034736758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034736758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:38.503041 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22687): Process ended prematurely: osmo-stp_10.42.42.5(pid=22687) [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22687)] [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:47:38.512585 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:47:38.540407 run osmo-hlr_10.42.42.2(pid=22684): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22684)] 03:47:38.589846 run osmo-hlr_10.42.42.2(pid=22684): stdout: | (launched: 2022-12-10_03:47:35.576695) 03:47:38.640752 run osmo-hlr_10.42.42.2(pid=22684): stderr: | 20221210034735776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034735776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034735776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034735776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034735776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034735776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034735790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034735798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034735798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034735798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:38.712266 run osmo-msc_10.42.42.6(pid=22690): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22690)] 03:47:38.761665 run osmo-msc_10.42.42.6(pid=22690): stdout: | (launched: 2022-12-10_03:47:37.584774) 03:47:38.812544 run osmo-msc_10.42.42.6(pid=22690): stderr: | 20221210034737907 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034737907 DLGLOBAL DEBUG validating counter group 0x7fb83938dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034737907 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034737907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034737907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034737908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034737909 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034737910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034737910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034737910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:38.863742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22683): Terminating (SIGTERM) 03:47:38.904678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22686): Terminating (SIGTERM) 03:47:38.945652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22689): Terminating (SIGTERM) 03:47:38.987136 --- ParallelTerminationStrategy: PID 22683 died... 03:47:39.006804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22683): Terminated: ok {rc=0} 03:47:39.052236 --- ParallelTerminationStrategy: PID 22686 died... 03:47:39.071458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22686): Terminated: ok {rc=0} 03:47:39.117129 --- ParallelTerminationStrategy: PID 22689 died... 03:47:39.136480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22689): Terminated: ok {rc=0} 03:47:39.222558 bus /sierra_3: Setting Powered False 03:47:40.320347 bus /sierra_3: Setting Powered False 03:47:41.436287 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:oc2g --------------------------------------------------------------------- 03:47:42.664782 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:42.669133 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 03:47:42.690134 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 03:47:42.716933 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 03:47:42.801359 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 03:47:42.821914 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 03:47:42.848836 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 03:47:43.428933 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 03:47:43.434074 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:43.444411 tst emergency:oc2g: Using 1 x bts (candidates: 1) 03:47:43.479713 tst emergency_mo_mt_call.py: using LAC 25773 03:47:43.594028 tst emergency_mo_mt_call.py: using RAC 18 03:47:43.710056 tst emergency_mo_mt_call.py: using CellId 25773 03:47:43.826410 tst emergency_mo_mt_call.py: using BVCI 25774 03:47:43.933343 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:43.943838 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:43.954204 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:43.964564 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:43.975107 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:43.985663 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:47:44.096375 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:47:44.209821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:44.660449 run create_hlr_db(pid=22695): Launched 03:47:44.771182 bus /sierra_2: Setting Powered False 03:47:45.839850 run create_hlr_db(pid=22695): Terminated: ok {rc=0} 03:47:46.309886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22697): Launched 03:47:46.639275 run osmo-hlr_10.42.42.2(pid=22698): Launched 03:47:46.821591 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:47.484198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22700): Launched 03:47:47.795053 run osmo-stp_10.42.42.5(pid=22701): Launched 03:47:47.922696 tst emergency_mo_mt_call.py: using MSISDN 7539 03:47:48.081867 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:48.641456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22703): Launched 03:47:48.952375 run osmo-msc_10.42.42.6(pid=22704): Launched 03:47:49.125988 run osmo-stp_10.42.42.5(pid=22701): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22701)] 03:47:49.256674 run osmo-stp_10.42.42.5(pid=22701): stdout: | (launched: 2022-12-10_03:47:47.738196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:49.389406 run osmo-stp_10.42.42.5(pid=22701): stderr: | 20221210034747929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034747929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034747929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034747930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034747930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034747930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034747930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:49.520300 run osmo-stp_10.42.42.5(pid=22701): stdout: | (launched: 2022-12-10_03:47:47.738196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:49.644570 run osmo-stp_10.42.42.5(pid=22701): stderr: | 20221210034747929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034747929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034747929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034747930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034747930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034747930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034747930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:49.792776 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22701): Process ended prematurely: osmo-stp_10.42.42.5(pid=22701) [trial-2369↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22701)] [trial-2369↪emergency:oc2g↪emergency_mo_mt_call.py:19] 03:47:49.801948 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 03:47:49.829018 run osmo-hlr_10.42.42.2(pid=22698): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22698)] 03:47:49.878056 run osmo-hlr_10.42.42.2(pid=22698): stdout: | (launched: 2022-12-10_03:47:46.574335) 03:47:49.928862 run osmo-hlr_10.42.42.2(pid=22698): stderr: | 20221210034746905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034746905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034746905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034746905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034746906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034746906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034746927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034746943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034746944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034746944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:49.999486 run osmo-msc_10.42.42.6(pid=22704): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22704)] 03:47:50.048808 run osmo-msc_10.42.42.6(pid=22704): stdout: | (launched: 2022-12-10_03:47:48.895136) 03:47:50.099369 run osmo-msc_10.42.42.6(pid=22704): stderr: | 20221210034749219 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034749219 DLGLOBAL DEBUG validating counter group 0x7f7c70dacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034749219 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034749219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034749219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034749219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034749221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034749222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034749222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034749222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:50.150099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22697): Terminating (SIGTERM) 03:47:50.190871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22700): Terminating (SIGTERM) 03:47:50.231932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22703): Terminating (SIGTERM) 03:47:50.273241 --- ParallelTerminationStrategy: PID 22697 died... 03:47:50.293170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22697): Terminated: ok {rc=0} 03:47:50.339423 --- ParallelTerminationStrategy: PID 22700 died... 03:47:50.359111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22700): Terminated: ok {rc=0} 03:47:50.404859 --- ParallelTerminationStrategy: PID 22703 died... 03:47:50.424736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22703): Terminated: ok {rc=0} 03:47:50.512227 bus /sierra_3: Setting Powered False 03:47:51.610447 bus /sierra_3: Setting Powered False 03:47:52.725923 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 03:47:53.812208 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:53.823879 tst emergency:oc2g: Using 1 x bts (candidates: 1) 03:47:53.862569 tst emergency_preemptive_call.py: using LAC 25774 03:47:53.985930 tst emergency_preemptive_call.py: using RAC 19 03:47:54.110447 tst emergency_preemptive_call.py: using CellId 25774 03:47:54.233694 tst emergency_preemptive_call.py: using BVCI 25775 03:47:54.346425 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:54.357287 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:54.368054 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:54.378888 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:54.389767 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:47:54.400371 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:47:54.517794 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:47:54.632616 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:47:54.745617 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:47:54.861590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:55.349390 run create_hlr_db(pid=22706): Launched 03:47:55.476331 bus /sierra_2: Setting Powered False 03:47:56.539304 run create_hlr_db(pid=22706): Terminated: ok {rc=0} 03:47:56.974089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22708): Launched 03:47:57.286085 run osmo-hlr_10.42.42.2(pid=22709): Launched 03:47:57.405107 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:57.945858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22711): Launched 03:47:58.256820 run osmo-stp_10.42.42.5(pid=22712): Launched 03:47:58.384853 tst emergency_preemptive_call.py: using MSISDN 7540 03:47:58.545783 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:59.104826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22714): Launched 03:47:59.416803 run osmo-msc_10.42.42.6(pid=22715): Launched 03:47:59.589586 run osmo-stp_10.42.42.5(pid=22712): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22712)] 03:47:59.720724 run osmo-stp_10.42.42.5(pid=22712): stdout: | (launched: 2022-12-10_03:47:58.199905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:59.852175 run osmo-stp_10.42.42.5(pid=22712): stderr: | 20221210034758394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034758394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034758395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034758395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034758395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034758396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034758396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:59.983145 run osmo-stp_10.42.42.5(pid=22712): stdout: | (launched: 2022-12-10_03:47:58.199905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:00.107656 run osmo-stp_10.42.42.5(pid=22712): stderr: | 20221210034758394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034758394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034758395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034758395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034758395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034758396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034758396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:00.255838 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22712): Process ended prematurely: osmo-stp_10.42.42.5(pid=22712) [trial-2369↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22712)] [trial-2369↪emergency:oc2g↪emergency_preemptive_call.py:32] 03:48:00.264536 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 03:48:00.291820 run osmo-hlr_10.42.42.2(pid=22709): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22709)] 03:48:00.341191 run osmo-hlr_10.42.42.2(pid=22709): stdout: | (launched: 2022-12-10_03:47:57.229075) 03:48:00.391827 run osmo-hlr_10.42.42.2(pid=22709): stderr: | 20221210034757428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034757428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034757428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034757429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034757429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034757429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034757441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034757449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034757449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034757450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:00.462839 run osmo-msc_10.42.42.6(pid=22715): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22715)] 03:48:00.511837 run osmo-msc_10.42.42.6(pid=22715): stdout: | (launched: 2022-12-10_03:47:59.359283) 03:48:00.562948 run osmo-msc_10.42.42.6(pid=22715): stderr: | 20221210034759681 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210034759681 DLGLOBAL DEBUG validating counter group 0x7f1350882c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210034759682 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210034759682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210034759682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210034759682 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210034759685 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210034759686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210034759686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210034759686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:00.614514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22708): Terminating (SIGTERM) 03:48:00.655307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22711): Terminating (SIGTERM) 03:48:00.697666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22714): Terminating (SIGTERM) 03:48:00.738799 --- ParallelTerminationStrategy: PID 22708 died... 03:48:00.758501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22708): Terminated: ok {rc=0} 03:48:00.803757 --- ParallelTerminationStrategy: PID 22711 died... 03:48:00.823000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22711): Terminated: ok {rc=0} 03:48:00.869426 --- ParallelTerminationStrategy: PID 22714 died... 03:48:00.889325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22714): Terminated: ok {rc=0} 03:48:00.978067 bus /sierra_9: Setting Powered False 03:48:02.094604 bus /sierra_9: Setting Powered False 03:48:03.209892 bus /sierra_8: Setting Powered False 03:48:04.308253 bus /sierra_8: Setting Powered False 03:48:05.421889 bus /sierra_3: Setting Powered False 03:48:06.516046 bus /sierra_3: Setting Powered False 03:48:07.630775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:oc2g --------------------------------------------------------------------- 03:48:08.888669 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:48:08.892832 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 03:48:08.913770 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 03:48:08.952323 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 03:48:09.039529 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 03:48:09.060924 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 03:48:09.100870 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 03:48:09.683866 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 03:48:09.732761 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:09.743160 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:09.777331 tst cs_paging_gprs_active.py: using LAC 25775 03:48:09.894462 tst cs_paging_gprs_active.py: using RAC 20 03:48:10.013269 tst cs_paging_gprs_active.py: using CellId 25775 03:48:10.130710 tst cs_paging_gprs_active.py: using BVCI 25776 03:48:10.240621 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.251251 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.261717 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.272257 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.282590 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.293115 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.303698 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.314279 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:10.324910 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:10.441612 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:10.559214 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:48:10.774616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:11.095233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22721): Launched 03:48:11.373218 run iperf3-srv_10.42.42.10(pid=22722): Launched 03:48:11.492729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:48:11.707410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:12.027145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22723): Launched 03:48:12.303976 run iperf3-srv_10.42.42.10(pid=22724): Launched 03:48:12.423683 tst cs_paging_gprs_active.py:38: start network... 03:48:12.639166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:13.133586 run create_hlr_db(pid=22725): Launched 03:48:13.262634 bus /sierra_2: Setting Powered False 03:48:14.326320 run create_hlr_db(pid=22725): Terminated: ok {rc=0} 03:48:14.751212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22727): Launched 03:48:15.049518 run osmo-hlr_10.42.42.2(pid=22728): Launched 03:48:15.162950 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:15.687305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22730): Launched 03:48:16.007996 run osmo-stp_10.42.42.5(pid=22731): Launched 03:48:16.346528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:48:16.942479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22733): Launched 03:48:17.076901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:48:17.342144 run patchelf(pid=22734): Launched 03:48:17.508270 run osmo-stp_10.42.42.5(pid=22731): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22731)] 03:48:17.634531 run osmo-stp_10.42.42.5(pid=22731): stdout: | (launched: 2022-12-10_03:48:15.947325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:17.763017 run osmo-stp_10.42.42.5(pid=22731): stderr: | 20221210034816261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034816262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034816262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034816263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034816263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034816264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034816264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:17.891101 run osmo-stp_10.42.42.5(pid=22731): stdout: | (launched: 2022-12-10_03:48:15.947325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:18.013669 run osmo-stp_10.42.42.5(pid=22731): stderr: | 20221210034816261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034816262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034816262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034816263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034816263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034816264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034816264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:18.158455 run patchelf(pid=22734): Terminating (SIGINT) 03:48:18.327501 run patchelf(pid=22734): Terminated: ok {rc=0} 03:48:18.449070 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22731): Process ended prematurely: osmo-stp_10.42.42.5(pid=22731) [trial-2369↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22731)] [trial-2369↪gprs:oc2g↪cs_paging_gprs_active.py:38] 03:48:18.458597 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:48:18.486371 run osmo-hlr_10.42.42.2(pid=22728): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22728)] 03:48:18.535105 run osmo-hlr_10.42.42.2(pid=22728): stdout: | (launched: 2022-12-10_03:48:14.994405) 03:48:18.584702 run osmo-hlr_10.42.42.2(pid=22728): stderr: | 20221210034815171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034815171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034815171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034815171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034815171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034815171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034815184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034815193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034815193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034815193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:18.634767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22721): Terminating (SIGTERM) 03:48:18.674861 run iperf3-srv_10.42.42.10(pid=22722): Terminating (SIGTERM) 03:48:18.715097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22723): Terminating (SIGTERM) 03:48:18.754882 run iperf3-srv_10.42.42.10(pid=22724): Terminating (SIGTERM) 03:48:18.794511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22727): Terminating (SIGTERM) 03:48:18.834606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22730): Terminating (SIGTERM) 03:48:18.874501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22733): Terminating (SIGTERM) 03:48:18.914648 --- ParallelTerminationStrategy: PID 22721 died... 03:48:18.933466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22721): Terminated: ok {rc=0} 03:48:18.978090 --- ParallelTerminationStrategy: PID 22722 died... 03:48:18.996345 run iperf3-srv_10.42.42.10(pid=22722): Terminated {rc=256} 03:48:19.040683 --- ParallelTerminationStrategy: PID 22723 died... 03:48:19.059006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22723): Terminated: ok {rc=0} 03:48:19.102142 --- ParallelTerminationStrategy: PID 22724 died... 03:48:19.120340 run iperf3-srv_10.42.42.10(pid=22724): Terminated {rc=256} 03:48:19.163235 --- ParallelTerminationStrategy: PID 22727 died... 03:48:19.181389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22727): Terminated: ok {rc=0} 03:48:19.225272 --- ParallelTerminationStrategy: PID 22730 died... 03:48:19.243456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22730): Terminated: ok {rc=0} 03:48:19.287373 --- ParallelTerminationStrategy: PID 22733 died... 03:48:19.305839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22733): Terminated: ok {rc=0} 03:48:19.391279 bus /gobi_0: Setting Powered False 03:48:20.488384 bus /gobi_0: Setting Powered False 03:48:21.602603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g iperf3.py ---------------------------------------------- 03:48:22.746568 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:22.757569 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:22.793341 tst iperf3.py: using LAC 25776 03:48:22.908395 tst iperf3.py: using RAC 21 03:48:23.024340 tst iperf3.py: using CellId 25776 03:48:23.154617 tst iperf3.py: using BVCI 25777 03:48:23.270624 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.281787 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.292771 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.304309 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.315863 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.327182 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.338508 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.349855 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:23.361217 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:23.477816 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:48:23.678976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:23.976907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22736): Launched 03:48:24.235370 run iperf3-srv_10.42.42.10(pid=22737): Launched 03:48:24.346431 tst iperf3.py:8: start network... 03:48:24.545443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:25.004630 run create_hlr_db(pid=22738): Launched 03:48:25.118328 bus /gobi_6: Setting Powered False 03:48:26.178591 run create_hlr_db(pid=22738): Terminated: ok {rc=0} 03:48:26.591810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22740): Launched 03:48:26.888318 run osmo-hlr_10.42.42.2(pid=22741): Launched 03:48:27.001780 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:27.522972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22743): Launched 03:48:27.841289 run osmo-stp_10.42.42.5(pid=22744): Launched 03:48:27.962497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:48:28.511675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22746): Launched 03:48:28.634108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:48:28.902336 run patchelf(pid=22747): Launched 03:48:29.079044 run osmo-stp_10.42.42.5(pid=22744): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22744)] 03:48:29.213837 run osmo-stp_10.42.42.5(pid=22744): stdout: | (launched: 2022-12-10_03:48:27.783330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:29.350020 run osmo-stp_10.42.42.5(pid=22744): stderr: | 20221210034827977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034827977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034827977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034827977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034827978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034827978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034827978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:29.486254 run osmo-stp_10.42.42.5(pid=22744): stdout: | (launched: 2022-12-10_03:48:27.783330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:29.616882 run osmo-stp_10.42.42.5(pid=22744): stderr: | 20221210034827977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034827977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034827977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034827977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034827978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034827978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034827978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:29.771035 run patchelf(pid=22747): Terminating (SIGINT) 03:48:29.949474 run patchelf(pid=22747): Terminated: ok {rc=0} 03:48:30.078403 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22744): Process ended prematurely: osmo-stp_10.42.42.5(pid=22744) [trial-2369↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22744)] [trial-2369↪gprs:oc2g↪iperf3.py:8] 03:48:30.088625 tst iperf3.py:8: Test FAILED (7.4 sec) 03:48:30.117015 run osmo-hlr_10.42.42.2(pid=22741): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22741)] 03:48:30.165967 run osmo-hlr_10.42.42.2(pid=22741): stdout: | (launched: 2022-12-10_03:48:26.833730) 03:48:30.216440 run osmo-hlr_10.42.42.2(pid=22741): stderr: | 20221210034827012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034827012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034827012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034827012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034827012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034827012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034827023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034827031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034827032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034827032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:30.267644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22736): Terminating (SIGTERM) 03:48:30.309044 run iperf3-srv_10.42.42.10(pid=22737): Terminating (SIGTERM) 03:48:30.350192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22740): Terminating (SIGTERM) 03:48:30.391367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22743): Terminating (SIGTERM) 03:48:30.432399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22746): Terminating (SIGTERM) 03:48:30.473668 --- ParallelTerminationStrategy: PID 22736 died... 03:48:30.493288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22736): Terminated: ok {rc=0} 03:48:30.538961 --- ParallelTerminationStrategy: PID 22737 died... 03:48:30.558250 run iperf3-srv_10.42.42.10(pid=22737): Terminated {rc=256} 03:48:30.603552 --- ParallelTerminationStrategy: PID 22740 died... 03:48:30.622883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22740): Terminated: ok {rc=0} 03:48:30.668011 --- ParallelTerminationStrategy: PID 22743 died... 03:48:30.687295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22743): Terminated: ok {rc=0} 03:48:30.732402 --- ParallelTerminationStrategy: PID 22746 died... 03:48:30.751678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22746): Terminated: ok {rc=0} 03:48:30.846664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g iperf3m4.py ---------------------------------------------- 03:48:32.011379 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.026082 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:32.066633 tst iperf3m4.py: using LAC 25777 03:48:32.185721 tst iperf3m4.py: using RAC 22 03:48:32.304808 tst iperf3m4.py: using CellId 25777 03:48:32.420439 tst iperf3m4.py: using BVCI 25778 03:48:32.527823 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.538235 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.548475 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.559089 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.569623 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.579914 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.590439 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.600815 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:32.611395 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:32.727948 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:32.843759 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:32.960789 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:33.075007 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:48:33.274325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:33.573298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22748): Launched 03:48:33.833709 run iperf3-srv_10.42.42.10(pid=22749): Launched 03:48:33.944639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:48:34.143944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:34.441825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22750): Launched 03:48:34.699027 run iperf3-srv_10.42.42.10(pid=22751): Launched 03:48:34.810159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:48:35.008144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:35.305844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22752): Launched 03:48:35.564041 run iperf3-srv_10.42.42.10(pid=22753): Launched 03:48:35.675294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:48:35.873409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:36.170765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22754): Launched 03:48:36.428721 run iperf3-srv_10.42.42.10(pid=22755): Launched 03:48:36.539375 tst iperf3m4.py:8: start network... 03:48:36.738090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:37.197520 run create_hlr_db(pid=22756): Launched 03:48:37.310950 bus /gobi_6: Setting Powered False 03:48:38.374010 run create_hlr_db(pid=22756): Terminated: ok {rc=0} 03:48:38.815685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22758): Launched 03:48:39.133621 run osmo-hlr_10.42.42.2(pid=22759): Launched 03:48:39.253991 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:39.798501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22761): Launched 03:48:40.115860 run osmo-stp_10.42.42.5(pid=22762): Launched 03:48:40.235924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:48:40.782888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22764): Launched 03:48:40.904789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:48:41.173715 run patchelf(pid=22765): Launched 03:48:41.349572 run osmo-stp_10.42.42.5(pid=22762): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22762)] 03:48:41.483679 run osmo-stp_10.42.42.5(pid=22762): stdout: | (launched: 2022-12-10_03:48:40.057466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:41.619719 run osmo-stp_10.42.42.5(pid=22762): stderr: | 20221210034840248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034840248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034840249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034840249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034840252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034840252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034840252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:41.757162 run osmo-stp_10.42.42.5(pid=22762): stdout: | (launched: 2022-12-10_03:48:40.057466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:41.887121 run osmo-stp_10.42.42.5(pid=22762): stderr: | 20221210034840248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034840248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034840249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034840249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034840252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034840252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034840252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:42.041402 run patchelf(pid=22765): Terminating (SIGINT) 03:48:42.219135 run patchelf(pid=22765): Terminated: ok {rc=0} 03:48:42.347166 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22762): Process ended prematurely: osmo-stp_10.42.42.5(pid=22762) [trial-2369↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22762)] [trial-2369↪gprs:oc2g↪iperf3m4.py:8] 03:48:42.357518 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:48:42.385973 run osmo-hlr_10.42.42.2(pid=22759): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22759)] 03:48:42.434988 run osmo-hlr_10.42.42.2(pid=22759): stdout: | (launched: 2022-12-10_03:48:39.075403) 03:48:42.486198 run osmo-hlr_10.42.42.2(pid=22759): stderr: | 20221210034839273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034839273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034839273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034839273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034839274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034839274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034839286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034839295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034839295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034839295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:42.537581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22748): Terminating (SIGTERM) 03:48:42.578790 run iperf3-srv_10.42.42.10(pid=22749): Terminating (SIGTERM) 03:48:42.619801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22750): Terminating (SIGTERM) 03:48:42.660780 run iperf3-srv_10.42.42.10(pid=22751): Terminating (SIGTERM) 03:48:42.701535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22752): Terminating (SIGTERM) 03:48:42.742531 run iperf3-srv_10.42.42.10(pid=22753): Terminating (SIGTERM) 03:48:42.783428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22754): Terminating (SIGTERM) 03:48:42.824399 run iperf3-srv_10.42.42.10(pid=22755): Terminating (SIGTERM) 03:48:42.865411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22758): Terminating (SIGTERM) 03:48:42.906515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22761): Terminating (SIGTERM) 03:48:42.947579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22764): Terminating (SIGTERM) 03:48:42.989210 --- ParallelTerminationStrategy: PID 22748 died... 03:48:43.009205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22748): Terminated: ok {rc=0} 03:48:43.055860 --- ParallelTerminationStrategy: PID 22749 died... 03:48:43.075526 run iperf3-srv_10.42.42.10(pid=22749): Terminated {rc=256} 03:48:43.121499 --- ParallelTerminationStrategy: PID 22750 died... 03:48:43.141095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22750): Terminated: ok {rc=0} 03:48:43.187193 --- ParallelTerminationStrategy: PID 22751 died... 03:48:43.206668 run iperf3-srv_10.42.42.10(pid=22751): Terminated {rc=256} 03:48:43.252412 --- ParallelTerminationStrategy: PID 22752 died... 03:48:43.272041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22752): Terminated: ok {rc=0} 03:48:43.317918 --- ParallelTerminationStrategy: PID 22753 died... 03:48:43.337484 run iperf3-srv_10.42.42.10(pid=22753): Terminated {rc=256} 03:48:43.383053 --- ParallelTerminationStrategy: PID 22754 died... 03:48:43.402552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22754): Terminated: ok {rc=0} 03:48:43.448054 --- ParallelTerminationStrategy: PID 22755 died... 03:48:43.467746 run iperf3-srv_10.42.42.10(pid=22755): Terminated {rc=256} 03:48:43.513508 --- ParallelTerminationStrategy: PID 22758 died... 03:48:43.533047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22758): Terminated: ok {rc=0} 03:48:43.578747 --- ParallelTerminationStrategy: PID 22761 died... 03:48:43.598317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22761): Terminated: ok {rc=0} 03:48:43.643964 --- ParallelTerminationStrategy: PID 22764 died... 03:48:43.663349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22764): Terminated: ok {rc=0} 03:48:43.750170 bus /gobi_4: Setting Powered False 03:48:44.846956 bus /gobi_4: Setting Powered False 03:48:45.976084 bus /gobi_1: Setting Powered False 03:48:47.082227 bus /gobi_1: Setting Powered False 03:48:48.201221 bus /gobi_0: Setting Powered False 03:48:49.298582 bus /gobi_0: Setting Powered False 03:48:50.413988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g ping.py ---------------------------------------------- 03:48:51.515632 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:51.526604 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:51.562135 tst ping.py: using LAC 25778 03:48:51.675972 tst ping.py: using RAC 23 03:48:51.790271 tst ping.py: using CellId 25778 03:48:51.903040 tst ping.py: using BVCI 25779 03:48:52.008338 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.019112 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.029441 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.040193 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.050699 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.061322 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.071756 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:52.082163 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:52.194533 tst ping.py:19: start network... 03:48:52.406983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:52.890197 run create_hlr_db(pid=22766): Launched 03:48:53.016586 bus /gobi_6: Setting Powered False 03:48:54.078994 run create_hlr_db(pid=22766): Terminated: ok {rc=0} 03:48:54.496006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22768): Launched 03:48:54.788294 run osmo-hlr_10.42.42.2(pid=22769): Launched 03:48:54.898931 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:55.411231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22771): Launched 03:48:55.704168 run osmo-stp_10.42.42.5(pid=22772): Launched 03:48:55.815926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:48:56.321093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22774): Launched 03:48:56.433776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:48:56.681061 run patchelf(pid=22775): Launched 03:48:56.843413 run osmo-stp_10.42.42.5(pid=22772): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22772)] 03:48:56.967396 run osmo-stp_10.42.42.5(pid=22772): stdout: | (launched: 2022-12-10_03:48:55.650124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:57.092638 run osmo-stp_10.42.42.5(pid=22772): stderr: | 20221210034855823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034855823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034855823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034855823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034855824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034855824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034855824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:57.218428 run osmo-stp_10.42.42.5(pid=22772): stdout: | (launched: 2022-12-10_03:48:55.650124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:57.338167 run osmo-stp_10.42.42.5(pid=22772): stderr: | 20221210034855823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034855823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034855823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034855823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034855824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034855824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034855824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:57.479786 run patchelf(pid=22775): Terminating (SIGINT) 03:48:57.643428 run patchelf(pid=22775): Terminated: ok {rc=0} 03:48:57.761711 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22772): Process ended prematurely: osmo-stp_10.42.42.5(pid=22772) [trial-2369↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22772)] [trial-2369↪gprs:oc2g↪ping.py:22] 03:48:57.770537 tst ping.py:22: Test FAILED (6.2 sec) 03:48:57.797801 run osmo-hlr_10.42.42.2(pid=22769): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22769)] 03:48:57.845322 run osmo-hlr_10.42.42.2(pid=22769): stdout: | (launched: 2022-12-10_03:48:54.734569) 03:48:57.893952 run osmo-hlr_10.42.42.2(pid=22769): stderr: | 20221210034854911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034854911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034854911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034854911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034854911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034854911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034854923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034854931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034854931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034854932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:57.943085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22768): Terminating (SIGTERM) 03:48:57.982347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22771): Terminating (SIGTERM) 03:48:58.022261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22774): Terminating (SIGTERM) 03:48:58.062434 --- ParallelTerminationStrategy: PID 22768 died... 03:48:58.081417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22768): Terminated: ok {rc=0} 03:48:58.125739 --- ParallelTerminationStrategy: PID 22771 died... 03:48:58.144360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22771): Terminated: ok {rc=0} 03:48:58.188515 --- ParallelTerminationStrategy: PID 22774 died... 03:48:58.207123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22774): Terminated: ok {rc=0} 03:48:58.291976 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 03:48:59.378912 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.389944 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:59.426231 tst ping_idle_ping.py: using LAC 25779 03:48:59.542529 tst ping_idle_ping.py: using RAC 24 03:48:59.658506 tst ping_idle_ping.py: using CellId 25779 03:48:59.772632 tst ping_idle_ping.py: using BVCI 25780 03:48:59.886824 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.897959 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.908890 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.920196 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.931296 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.942553 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.953819 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:59.964878 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:00.081854 tst ping_idle_ping.py:24: start network... 03:49:00.292576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:00.778900 run create_hlr_db(pid=22776): Launched 03:49:00.909371 bus /gobi_6: Setting Powered False 03:49:01.971851 run create_hlr_db(pid=22776): Terminated: ok {rc=0} 03:49:02.413026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22778): Launched 03:49:02.727061 run osmo-hlr_10.42.42.2(pid=22779): Launched 03:49:02.845461 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:03.388613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22781): Launched 03:49:03.701115 run osmo-stp_10.42.42.5(pid=22782): Launched 03:49:03.819686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:04.359470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22784): Launched 03:49:04.479145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:04.743557 run patchelf(pid=22785): Launched 03:49:04.907155 run osmo-stp_10.42.42.5(pid=22782): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22782)] 03:49:05.031764 run osmo-stp_10.42.42.5(pid=22782): stdout: | (launched: 2022-12-10_03:49:03.643794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:05.157968 run osmo-stp_10.42.42.5(pid=22782): stderr: | 20221210034903836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034903836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034903836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034903837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034903837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034903837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034903837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:05.284029 run osmo-stp_10.42.42.5(pid=22782): stdout: | (launched: 2022-12-10_03:49:03.643794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:05.404588 run osmo-stp_10.42.42.5(pid=22782): stderr: | 20221210034903836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034903836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034903836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034903837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034903837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034903837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034903837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:05.547031 run patchelf(pid=22785): Terminating (SIGINT) 03:49:05.711722 run patchelf(pid=22785): Terminated: ok {rc=0} 03:49:05.830711 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22782): Process ended prematurely: osmo-stp_10.42.42.5(pid=22782) [trial-2369↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22782)] [trial-2369↪gprs:oc2g↪ping_idle_ping.py:27] 03:49:05.839783 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:49:05.867193 run osmo-hlr_10.42.42.2(pid=22779): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22779)] 03:49:05.914445 run osmo-hlr_10.42.42.2(pid=22779): stdout: | (launched: 2022-12-10_03:49:02.669016) 03:49:05.962838 run osmo-hlr_10.42.42.2(pid=22779): stderr: | 20221210034902870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034902870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034902870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034902870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034902870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034902870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034902882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034902890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034902890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034902890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:06.011878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22778): Terminating (SIGTERM) 03:49:06.051083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22781): Terminating (SIGTERM) 03:49:06.090412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22784): Terminating (SIGTERM) 03:49:06.130155 --- ParallelTerminationStrategy: PID 22778 died... 03:49:06.149230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22778): Terminated: ok {rc=0} 03:49:06.193358 --- ParallelTerminationStrategy: PID 22781 died... 03:49:06.211977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22781): Terminated: ok {rc=0} 03:49:06.255982 --- ParallelTerminationStrategy: PID 22784 died... 03:49:06.274654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22784): Terminated: ok {rc=0} 03:49:06.360482 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 03:49:07.649716 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:49:07.655242 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:49:07.676763 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:49:07.714790 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:49:07.800851 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:49:07.822370 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:49:07.860174 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:49:08.449974 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:49:08.496893 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:08.507486 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:08.543992 tst cs_paging_gprs_active.py: using LAC 25780 03:49:08.659486 tst cs_paging_gprs_active.py: using RAC 25 03:49:08.772256 tst cs_paging_gprs_active.py: using CellId 25780 03:49:08.886393 tst cs_paging_gprs_active.py: using BVCI 25781 03:49:08.993293 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.003819 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.014274 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.024809 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.035317 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.045897 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.056576 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.067208 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:09.077933 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:09.194598 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:09.307638 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:49:09.503862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:09.796761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22790): Launched 03:49:10.050961 run iperf3-srv_10.42.42.10(pid=22791): Launched 03:49:10.160182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:49:10.355322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:10.648064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22792): Launched 03:49:10.901774 run iperf3-srv_10.42.42.10(pid=22793): Launched 03:49:11.010476 tst cs_paging_gprs_active.py:38: start network... 03:49:11.205578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:11.657212 run create_hlr_db(pid=22794): Launched 03:49:11.767984 bus /gobi_6: Setting Powered False 03:49:12.830585 run create_hlr_db(pid=22794): Terminated: ok {rc=0} 03:49:13.259116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22796): Launched 03:49:13.550310 run osmo-hlr_10.42.42.2(pid=22797): Launched 03:49:13.662991 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:14.169359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22799): Launched 03:49:14.461013 run osmo-stp_10.42.42.5(pid=22800): Launched 03:49:14.573228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:15.077254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22802): Launched 03:49:15.188716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:15.435120 run patchelf(pid=22803): Launched 03:49:15.597228 run osmo-stp_10.42.42.5(pid=22800): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22800)] 03:49:15.721276 run osmo-stp_10.42.42.5(pid=22800): stdout: | (launched: 2022-12-10_03:49:14.407127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:15.859320 run osmo-stp_10.42.42.5(pid=22800): stderr: | 20221210034914576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034914576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034914577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034914577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034914578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034914578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034914578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:15.998289 run osmo-stp_10.42.42.5(pid=22800): stdout: | (launched: 2022-12-10_03:49:14.407127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:16.131320 run osmo-stp_10.42.42.5(pid=22800): stderr: | 20221210034914576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034914576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034914577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034914577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034914578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034914578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034914578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:16.286009 run patchelf(pid=22803): Terminating (SIGINT) 03:49:16.466602 run patchelf(pid=22803): Terminated: ok {rc=0} 03:49:16.597142 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22800): Process ended prematurely: osmo-stp_10.42.42.5(pid=22800) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22800)] [trial-2369↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:49:16.608081 tst cs_paging_gprs_active.py:38: Test FAILED (8.1 sec) 03:49:16.638100 run osmo-hlr_10.42.42.2(pid=22797): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22797)] 03:49:16.690866 run osmo-hlr_10.42.42.2(pid=22797): stdout: | (launched: 2022-12-10_03:49:13.496284) 03:49:16.745245 run osmo-hlr_10.42.42.2(pid=22797): stderr: | 20221210034913669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034913669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034913669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034913669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034913669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034913669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034913681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034913690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034913690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034913690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:16.799807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22790): Terminating (SIGTERM) 03:49:16.843285 run iperf3-srv_10.42.42.10(pid=22791): Terminating (SIGTERM) 03:49:16.889285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22792): Terminating (SIGTERM) 03:49:16.933994 run iperf3-srv_10.42.42.10(pid=22793): Terminating (SIGTERM) 03:49:16.979436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22796): Terminating (SIGTERM) 03:49:17.023288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22799): Terminating (SIGTERM) 03:49:17.068866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22802): Terminating (SIGTERM) 03:49:17.113540 --- ParallelTerminationStrategy: PID 22790 died... 03:49:17.134831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22790): Terminated: ok {rc=0} 03:49:17.183050 --- ParallelTerminationStrategy: PID 22791 died... 03:49:17.202782 run iperf3-srv_10.42.42.10(pid=22791): Terminated {rc=256} 03:49:17.248624 --- ParallelTerminationStrategy: PID 22792 died... 03:49:17.267937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22792): Terminated: ok {rc=0} 03:49:17.313750 --- ParallelTerminationStrategy: PID 22793 died... 03:49:17.333254 run iperf3-srv_10.42.42.10(pid=22793): Terminated {rc=256} 03:49:17.378726 --- ParallelTerminationStrategy: PID 22796 died... 03:49:17.398009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22796): Terminated: ok {rc=0} 03:49:17.443296 --- ParallelTerminationStrategy: PID 22799 died... 03:49:17.462632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22799): Terminated: ok {rc=0} 03:49:17.508515 --- ParallelTerminationStrategy: PID 22802 died... 03:49:17.528105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22802): Terminated: ok {rc=0} 03:49:17.615540 bus /gobi_0: Setting Powered False 03:49:18.712401 bus /gobi_0: Setting Powered False 03:49:19.827384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:49:20.972464 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:20.984233 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:21.022816 tst iperf3.py: using LAC 25781 03:49:21.147782 tst iperf3.py: using RAC 26 03:49:21.263064 tst iperf3.py: using CellId 25781 03:49:21.381560 tst iperf3.py: using BVCI 25782 03:49:21.489157 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.499712 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.510305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.521132 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.532013 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.542669 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.553433 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.564284 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:21.575114 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:21.688731 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:49:21.884388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:22.178032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22805): Launched 03:49:22.431451 run iperf3-srv_10.42.42.10(pid=22806): Launched 03:49:22.539995 tst iperf3.py:8: start network... 03:49:22.734943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:23.184852 run create_hlr_db(pid=22807): Launched 03:49:23.295663 bus /gobi_6: Setting Powered False 03:49:24.355103 run create_hlr_db(pid=22807): Terminated: ok {rc=0} 03:49:24.761494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22809): Launched 03:49:25.052199 run osmo-hlr_10.42.42.2(pid=22810): Launched 03:49:25.163254 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:25.663641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22812): Launched 03:49:25.955829 run osmo-stp_10.42.42.5(pid=22813): Launched 03:49:26.067073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:26.569122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22815): Launched 03:49:26.680747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:26.926982 run patchelf(pid=22816): Launched 03:49:27.088571 run osmo-stp_10.42.42.5(pid=22813): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22813)] 03:49:27.212644 run osmo-stp_10.42.42.5(pid=22813): stdout: | (launched: 2022-12-10_03:49:25.902150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:27.338606 run osmo-stp_10.42.42.5(pid=22813): stderr: | 20221210034926073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034926073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034926073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034926074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034926074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034926074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034926074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:27.464530 run osmo-stp_10.42.42.5(pid=22813): stdout: | (launched: 2022-12-10_03:49:25.902150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:27.584237 run osmo-stp_10.42.42.5(pid=22813): stderr: | 20221210034926073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034926073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034926073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034926074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034926074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034926074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034926074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:27.726351 run patchelf(pid=22816): Terminating (SIGINT) 03:49:27.890744 run patchelf(pid=22816): Terminated: ok {rc=0} 03:49:28.009731 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22813): Process ended prematurely: osmo-stp_10.42.42.5(pid=22813) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22813)] [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 03:49:28.019363 tst iperf3.py:8: Test FAILED (7.1 sec) 03:49:28.046752 run osmo-hlr_10.42.42.2(pid=22810): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22810)] 03:49:28.093885 run osmo-hlr_10.42.42.2(pid=22810): stdout: | (launched: 2022-12-10_03:49:24.998654) 03:49:28.142711 run osmo-hlr_10.42.42.2(pid=22810): stderr: | 20221210034925172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034925172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034925172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034925172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034925173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034925173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034925184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034925192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034925193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034925193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:28.191848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22805): Terminating (SIGTERM) 03:49:28.231458 run iperf3-srv_10.42.42.10(pid=22806): Terminating (SIGTERM) 03:49:28.270984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22809): Terminating (SIGTERM) 03:49:28.310498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22812): Terminating (SIGTERM) 03:49:28.349940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22815): Terminating (SIGTERM) 03:49:28.389454 --- ParallelTerminationStrategy: PID 22805 died... 03:49:28.408197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22805): Terminated: ok {rc=0} 03:49:28.452152 --- ParallelTerminationStrategy: PID 22806 died... 03:49:28.470408 run iperf3-srv_10.42.42.10(pid=22806): Terminated {rc=256} 03:49:28.514290 --- ParallelTerminationStrategy: PID 22809 died... 03:49:28.532680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22809): Terminated: ok {rc=0} 03:49:28.576376 --- ParallelTerminationStrategy: PID 22812 died... 03:49:28.594755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22812): Terminated: ok {rc=0} 03:49:28.638436 --- ParallelTerminationStrategy: PID 22815 died... 03:49:28.656763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22815): Terminated: ok {rc=0} 03:49:28.740742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:49:29.880706 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:29.891919 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:29.928846 tst iperf3m4.py: using LAC 25782 03:49:30.042756 tst iperf3m4.py: using RAC 27 03:49:30.156567 tst iperf3m4.py: using CellId 25782 03:49:30.271005 tst iperf3m4.py: using BVCI 25783 03:49:30.377577 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.388232 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.398818 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.409576 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.420153 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.430800 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.441754 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.452376 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:30.463143 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:30.577786 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:30.691052 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:30.805176 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:30.926631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:49:31.160470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:31.490088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22817): Launched 03:49:31.840213 run iperf3-srv_10.42.42.10(pid=22818): Launched 03:49:31.956629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:49:32.164174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:32.463871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22819): Launched 03:49:32.717890 run iperf3-srv_10.42.42.10(pid=22820): Launched 03:49:32.826965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:49:33.022335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:33.314510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22821): Launched 03:49:33.567581 run iperf3-srv_10.42.42.10(pid=22822): Launched 03:49:33.675577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:49:33.869943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:34.162577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22823): Launched 03:49:34.415613 run iperf3-srv_10.42.42.10(pid=22824): Launched 03:49:34.523997 tst iperf3m4.py:8: start network... 03:49:34.717871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:35.167828 run create_hlr_db(pid=22825): Launched 03:49:35.279341 bus /gobi_6: Setting Powered False 03:49:36.338438 run create_hlr_db(pid=22825): Terminated: ok {rc=0} 03:49:36.764051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22827): Launched 03:49:37.077306 run osmo-hlr_10.42.42.2(pid=22828): Launched 03:49:37.196258 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:37.732230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22830): Launched 03:49:38.043521 run osmo-stp_10.42.42.5(pid=22831): Launched 03:49:38.163185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:38.699482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22833): Launched 03:49:38.819542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:39.083308 run patchelf(pid=22834): Launched 03:49:39.256358 run osmo-stp_10.42.42.5(pid=22831): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22831)] 03:49:39.388387 run osmo-stp_10.42.42.5(pid=22831): stdout: | (launched: 2022-12-10_03:49:37.986710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:39.522523 run osmo-stp_10.42.42.5(pid=22831): stderr: | 20221210034938176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034938176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034938177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034938177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034938178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034938178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034938178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:39.656579 run osmo-stp_10.42.42.5(pid=22831): stdout: | (launched: 2022-12-10_03:49:37.986710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:39.784279 run osmo-stp_10.42.42.5(pid=22831): stderr: | 20221210034938176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034938176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034938177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034938177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034938178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034938178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034938178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:39.935543 run patchelf(pid=22834): Terminating (SIGINT) 03:49:40.110168 run patchelf(pid=22834): Terminated: ok {rc=0} 03:49:40.236028 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22831): Process ended prematurely: osmo-stp_10.42.42.5(pid=22831) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22831)] [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 03:49:40.246439 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:49:40.274671 run osmo-hlr_10.42.42.2(pid=22828): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22828)] 03:49:40.323680 run osmo-hlr_10.42.42.2(pid=22828): stdout: | (launched: 2022-12-10_03:49:37.019684) 03:49:40.374443 run osmo-hlr_10.42.42.2(pid=22828): stderr: | 20221210034937219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034937219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034937219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034937219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034937219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034937219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034937231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034937241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034937241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034937241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:40.425415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22817): Terminating (SIGTERM) 03:49:40.466625 run iperf3-srv_10.42.42.10(pid=22818): Terminating (SIGTERM) 03:49:40.507684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22819): Terminating (SIGTERM) 03:49:40.548773 run iperf3-srv_10.42.42.10(pid=22820): Terminating (SIGTERM) 03:49:40.589879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22821): Terminating (SIGTERM) 03:49:40.631066 run iperf3-srv_10.42.42.10(pid=22822): Terminating (SIGTERM) 03:49:40.671953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22823): Terminating (SIGTERM) 03:49:40.713028 run iperf3-srv_10.42.42.10(pid=22824): Terminating (SIGTERM) 03:49:40.754129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22827): Terminating (SIGTERM) 03:49:40.795129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22830): Terminating (SIGTERM) 03:49:40.836125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22833): Terminating (SIGTERM) 03:49:40.877449 --- ParallelTerminationStrategy: PID 22817 died... 03:49:40.897130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22817): Terminated: ok {rc=0} 03:49:40.943035 --- ParallelTerminationStrategy: PID 22818 died... 03:49:40.962321 run iperf3-srv_10.42.42.10(pid=22818): Terminated {rc=256} 03:49:41.007736 --- ParallelTerminationStrategy: PID 22819 died... 03:49:41.027081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22819): Terminated: ok {rc=0} 03:49:41.072523 --- ParallelTerminationStrategy: PID 22820 died... 03:49:41.091826 run iperf3-srv_10.42.42.10(pid=22820): Terminated {rc=256} 03:49:41.137252 --- ParallelTerminationStrategy: PID 22821 died... 03:49:41.156411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22821): Terminated: ok {rc=0} 03:49:41.201489 --- ParallelTerminationStrategy: PID 22822 died... 03:49:41.220558 run iperf3-srv_10.42.42.10(pid=22822): Terminated {rc=256} 03:49:41.265637 --- ParallelTerminationStrategy: PID 22823 died... 03:49:41.284748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22823): Terminated: ok {rc=0} 03:49:41.330018 --- ParallelTerminationStrategy: PID 22824 died... 03:49:41.349344 run iperf3-srv_10.42.42.10(pid=22824): Terminated {rc=256} 03:49:41.394264 --- ParallelTerminationStrategy: PID 22827 died... 03:49:41.413464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22827): Terminated: ok {rc=0} 03:49:41.458810 --- ParallelTerminationStrategy: PID 22830 died... 03:49:41.478138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22830): Terminated: ok {rc=0} 03:49:41.523830 --- ParallelTerminationStrategy: PID 22833 died... 03:49:41.543382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22833): Terminated: ok {rc=0} 03:49:41.630301 bus /gobi_4: Setting Powered False 03:49:42.729941 bus /gobi_4: Setting Powered False 03:49:43.846071 bus /gobi_1: Setting Powered False 03:49:44.943549 bus /gobi_1: Setting Powered False 03:49:46.053858 bus /gobi_0: Setting Powered False 03:49:47.152897 bus /gobi_0: Setting Powered False 03:49:48.268777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 03:49:49.370807 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.382661 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:49.430775 tst ping.py: using LAC 25783 03:49:49.558740 tst ping.py: using RAC 28 03:49:49.679912 tst ping.py: using CellId 25783 03:49:49.795059 tst ping.py: using BVCI 25784 03:49:49.898454 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.909395 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.919878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.930866 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.941732 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.952370 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.963238 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:49.973972 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:50.088538 tst ping.py:19: start network... 03:49:50.294959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:50.766424 run create_hlr_db(pid=22835): Launched 03:49:50.889578 bus /gobi_6: Setting Powered False 03:49:51.950384 run create_hlr_db(pid=22835): Terminated: ok {rc=0} 03:49:52.377714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22837): Launched 03:49:52.683031 run osmo-hlr_10.42.42.2(pid=22838): Launched 03:49:52.798932 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:53.326431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22840): Launched 03:49:53.631330 run osmo-stp_10.42.42.5(pid=22841): Launched 03:49:53.747901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:54.276487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22843): Launched 03:49:54.393555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:54.651580 run patchelf(pid=22844): Launched 03:49:54.820782 run osmo-stp_10.42.42.5(pid=22841): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22841)] 03:49:54.950729 run osmo-stp_10.42.42.5(pid=22841): stdout: | (launched: 2022-12-10_03:49:53.575302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:55.082373 run osmo-stp_10.42.42.5(pid=22841): stderr: | 20221210034953766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034953767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034953767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034953767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034953768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034953768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034953768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:55.213616 run osmo-stp_10.42.42.5(pid=22841): stdout: | (launched: 2022-12-10_03:49:53.575302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:55.339631 run osmo-stp_10.42.42.5(pid=22841): stderr: | 20221210034953766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210034953767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210034953767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210034953767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210034953768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210034953768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210034953768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:55.488394 run patchelf(pid=22844): Terminating (SIGINT) 03:49:55.660027 run patchelf(pid=22844): Terminated: ok {rc=0} 03:49:55.784164 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22841): Process ended prematurely: osmo-stp_10.42.42.5(pid=22841) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22841)] [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 03:49:55.793816 tst ping.py:22: Test FAILED (6.4 sec) 03:49:55.821670 run osmo-hlr_10.42.42.2(pid=22838): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22838)] 03:49:55.870870 run osmo-hlr_10.42.42.2(pid=22838): stdout: | (launched: 2022-12-10_03:49:52.627114) 03:49:55.921951 run osmo-hlr_10.42.42.2(pid=22838): stderr: | 20221210034952826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210034952826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210034952826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210034952826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210034952826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210034952826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210034952838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210034952846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210034952846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210034952846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:55.973475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22837): Terminating (SIGTERM) 03:49:56.014892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22840): Terminating (SIGTERM) 03:49:56.056643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22843): Terminating (SIGTERM) 03:49:56.098447 --- ParallelTerminationStrategy: PID 22837 died... 03:49:56.118307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22837): Terminated: ok {rc=0} 03:49:56.164125 --- ParallelTerminationStrategy: PID 22840 died... 03:49:56.183773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22840): Terminated: ok {rc=0} 03:49:56.229628 --- ParallelTerminationStrategy: PID 22843 died... 03:49:56.249053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22843): Terminated: ok {rc=0} 03:49:56.335945 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:49:57.423395 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:57.435054 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:57.477079 tst ping_idle_ping.py: using LAC 25784 03:49:57.591822 tst ping_idle_ping.py: using RAC 29 03:49:57.712467 tst ping_idle_ping.py: using CellId 25784 03:49:57.831260 tst ping_idle_ping.py: using BVCI 25785 03:49:57.942005 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:57.953271 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:57.964434 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:57.975472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:57.986418 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:57.997335 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:58.008343 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:58.019414 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:58.136768 tst ping_idle_ping.py:24: start network... 03:49:58.331542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:58.781070 run create_hlr_db(pid=22845): Launched 03:49:58.891653 bus /gobi_6: Setting Powered False 03:49:59.949715 run create_hlr_db(pid=22845): Terminated: ok {rc=0} 03:50:00.353568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22847): Launched 03:50:00.642631 run osmo-hlr_10.42.42.2(pid=22848): Launched 03:50:00.753052 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:01.348028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22850): Launched 03:50:01.763547 run osmo-stp_10.42.42.5(pid=22851): Launched 03:50:01.910734 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:02.607173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22856): Launched 03:50:02.725472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:02.984842 run patchelf(pid=22857): Launched 03:50:03.156272 run osmo-stp_10.42.42.5(pid=22851): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22851)] 03:50:03.286999 run osmo-stp_10.42.42.5(pid=22851): stdout: | (launched: 2022-12-10_03:50:01.686963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:03.419106 run osmo-stp_10.42.42.5(pid=22851): stderr: | 20221210035002011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035002011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035002012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035002012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035002013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035002013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035002013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:03.551399 run osmo-stp_10.42.42.5(pid=22851): stdout: | (launched: 2022-12-10_03:50:01.686963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:03.678197 run osmo-stp_10.42.42.5(pid=22851): stderr: | 20221210035002011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035002011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035002012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035002012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035002013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035002013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035002013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:03.827556 run patchelf(pid=22857): Terminating (SIGINT) 03:50:03.999778 run patchelf(pid=22857): Terminated: ok {rc=0} 03:50:04.124906 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22851): Process ended prematurely: osmo-stp_10.42.42.5(pid=22851) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22851)] [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 03:50:04.134650 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:50:04.162735 run osmo-hlr_10.42.42.2(pid=22848): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22848)] 03:50:04.212087 run osmo-hlr_10.42.42.2(pid=22848): stdout: | (launched: 2022-12-10_03:50:00.589797) 03:50:04.263085 run osmo-hlr_10.42.42.2(pid=22848): stderr: | 20221210035000763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035000763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035000763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035000763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035000763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035000763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035000775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035000785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035000786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035000786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:04.314709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22847): Terminating (SIGTERM) 03:50:04.357127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22850): Terminating (SIGTERM) 03:50:04.398850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22856): Terminating (SIGTERM) 03:50:04.440776 --- ParallelTerminationStrategy: PID 22847 died... 03:50:04.460806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22847): Terminated: ok {rc=0} 03:50:04.507141 --- ParallelTerminationStrategy: PID 22850 died... 03:50:04.526680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22850): Terminated: ok {rc=0} 03:50:04.573019 --- ParallelTerminationStrategy: PID 22856 died... 03:50:04.592549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22856): Terminated: ok {rc=0} 03:50:04.680399 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:50:05.978369 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:50:05.985306 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:50:06.006697 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:50:06.046558 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:50:06.136165 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:50:06.157270 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:50:06.196519 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:50:06.793675 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:50:06.844534 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:06.855854 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:06.912252 tst cs_paging_gprs_active.py: using LAC 25785 03:50:07.034294 tst cs_paging_gprs_active.py: using RAC 30 03:50:07.155943 tst cs_paging_gprs_active.py: using CellId 25785 03:50:07.276813 tst cs_paging_gprs_active.py: using BVCI 25786 03:50:07.390155 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.401457 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.412291 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.423480 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.434563 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.445727 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.456940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.468026 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:07.479525 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:07.594183 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:07.711243 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:50:07.909114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:08.204270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22861): Launched 03:50:08.460664 run iperf3-srv_10.42.42.10(pid=22863): Launched 03:50:08.570968 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:50:08.768628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:09.064703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22864): Launched 03:50:09.321317 run iperf3-srv_10.42.42.10(pid=22865): Launched 03:50:09.431299 tst cs_paging_gprs_active.py:38: start network... 03:50:09.628329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:10.082939 run create_hlr_db(pid=22866): Launched 03:50:10.194972 bus /gobi_6: Setting Powered False 03:50:11.253679 run create_hlr_db(pid=22866): Terminated: ok {rc=0} 03:50:11.683157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22868): Launched 03:50:11.995795 run osmo-hlr_10.42.42.2(pid=22869): Launched 03:50:12.115682 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:12.654173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22871): Launched 03:50:12.966778 run osmo-stp_10.42.42.5(pid=22872): Launched 03:50:13.086075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:13.625121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22874): Launched 03:50:13.744197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:14.010043 run patchelf(pid=22875): Launched 03:50:14.184259 run osmo-stp_10.42.42.5(pid=22872): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22872)] 03:50:14.317197 run osmo-stp_10.42.42.5(pid=22872): stdout: | (launched: 2022-12-10_03:50:12.909297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:14.452797 run osmo-stp_10.42.42.5(pid=22872): stderr: | 20221210035013099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035013099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035013099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035013100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035013100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035013100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035013100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:14.587554 run osmo-stp_10.42.42.5(pid=22872): stdout: | (launched: 2022-12-10_03:50:12.909297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:14.716136 run osmo-stp_10.42.42.5(pid=22872): stderr: | 20221210035013099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035013099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035013099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035013100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035013100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035013100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035013100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:14.868227 run patchelf(pid=22875): Terminating (SIGINT) 03:50:15.044148 run patchelf(pid=22875): Terminated: ok {rc=0} 03:50:15.172254 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22872): Process ended prematurely: osmo-stp_10.42.42.5(pid=22872) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22872)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:50:15.182671 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:50:15.211048 run osmo-hlr_10.42.42.2(pid=22869): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22869)] 03:50:15.260603 run osmo-hlr_10.42.42.2(pid=22869): stdout: | (launched: 2022-12-10_03:50:11.938677) 03:50:15.311888 run osmo-hlr_10.42.42.2(pid=22869): stderr: | 20221210035012135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035012136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035012136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035012136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035012136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035012136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035012149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035012157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035012157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035012157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:15.363654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22861): Terminating (SIGTERM) 03:50:15.405413 run iperf3-srv_10.42.42.10(pid=22863): Terminating (SIGTERM) 03:50:15.447045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22864): Terminating (SIGTERM) 03:50:15.488830 run iperf3-srv_10.42.42.10(pid=22865): Terminating (SIGTERM) 03:50:15.530341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22868): Terminating (SIGTERM) 03:50:15.572357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22871): Terminating (SIGTERM) 03:50:15.614159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22874): Terminating (SIGTERM) 03:50:15.656065 --- ParallelTerminationStrategy: PID 22861 died... 03:50:15.675941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22861): Terminated: ok {rc=0} 03:50:15.722274 --- ParallelTerminationStrategy: PID 22863 died... 03:50:15.741616 run iperf3-srv_10.42.42.10(pid=22863): Terminated {rc=256} 03:50:15.787305 --- ParallelTerminationStrategy: PID 22864 died... 03:50:15.806658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22864): Terminated: ok {rc=0} 03:50:15.866285 --- ParallelTerminationStrategy: PID 22865 died... 03:50:15.885985 run iperf3-srv_10.42.42.10(pid=22865): Terminated {rc=256} 03:50:15.932461 --- ParallelTerminationStrategy: PID 22868 died... 03:50:15.952233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22868): Terminated: ok {rc=0} 03:50:15.998815 --- ParallelTerminationStrategy: PID 22871 died... 03:50:16.018596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22871): Terminated: ok {rc=0} 03:50:16.065457 --- ParallelTerminationStrategy: PID 22874 died... 03:50:16.085163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22874): Terminated: ok {rc=0} 03:50:16.181135 bus /gobi_0: Setting Powered False 03:50:17.285581 bus /gobi_0: Setting Powered False 03:50:18.398413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:50:19.543972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:19.555833 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:19.620129 tst iperf3.py: using LAC 25786 03:50:19.746108 tst iperf3.py: using RAC 31 03:50:19.868456 tst iperf3.py: using CellId 25786 03:50:19.989498 tst iperf3.py: using BVCI 25787 03:50:20.103150 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.114863 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.125965 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.137133 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.148196 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.159710 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.171064 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.182272 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:20.193613 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:20.304933 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:50:20.503633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:20.798510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22876): Launched 03:50:21.053476 run iperf3-srv_10.42.42.10(pid=22877): Launched 03:50:21.163793 tst iperf3.py:8: start network... 03:50:21.360188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:21.810613 run create_hlr_db(pid=22878): Launched 03:50:21.922729 bus /gobi_6: Setting Powered False 03:50:22.981142 run create_hlr_db(pid=22878): Terminated: ok {rc=0} 03:50:23.406493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22880): Launched 03:50:23.717781 run osmo-hlr_10.42.42.2(pid=22881): Launched 03:50:23.836212 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:24.373557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22883): Launched 03:50:24.684654 run osmo-stp_10.42.42.5(pid=22884): Launched 03:50:24.803118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:25.340875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22886): Launched 03:50:25.460263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:25.723702 run patchelf(pid=22887): Launched 03:50:25.887279 run osmo-stp_10.42.42.5(pid=22884): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22884)] 03:50:26.011590 run osmo-stp_10.42.42.5(pid=22884): stdout: | (launched: 2022-12-10_03:50:24.627932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:26.138221 run osmo-stp_10.42.42.5(pid=22884): stderr: | 20221210035024819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035024820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035024820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035024820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035024821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035024821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035024821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:26.264502 run osmo-stp_10.42.42.5(pid=22884): stdout: | (launched: 2022-12-10_03:50:24.627932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:26.384596 run osmo-stp_10.42.42.5(pid=22884): stderr: | 20221210035024819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035024820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035024820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035024820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035024821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035024821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035024821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:26.526849 run patchelf(pid=22887): Terminating (SIGINT) 03:50:26.691935 run patchelf(pid=22887): Terminated: ok {rc=0} 03:50:26.811221 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22884): Process ended prematurely: osmo-stp_10.42.42.5(pid=22884) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22884)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 03:50:26.820770 tst iperf3.py:8: Test FAILED (7.3 sec) 03:50:26.848071 run osmo-hlr_10.42.42.2(pid=22881): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22881)] 03:50:26.895239 run osmo-hlr_10.42.42.2(pid=22881): stdout: | (launched: 2022-12-10_03:50:23.661019) 03:50:26.944090 run osmo-hlr_10.42.42.2(pid=22881): stderr: | 20221210035023859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035023859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035023859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035023860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035023860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035023860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035023872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035023882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035023882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035023882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:26.993408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22876): Terminating (SIGTERM) 03:50:27.032912 run iperf3-srv_10.42.42.10(pid=22877): Terminating (SIGTERM) 03:50:27.072364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22880): Terminating (SIGTERM) 03:50:27.111714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22883): Terminating (SIGTERM) 03:50:27.151211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22886): Terminating (SIGTERM) 03:50:27.190806 --- ParallelTerminationStrategy: PID 22876 died... 03:50:27.209678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22876): Terminated: ok {rc=0} 03:50:27.254064 --- ParallelTerminationStrategy: PID 22877 died... 03:50:27.272360 run iperf3-srv_10.42.42.10(pid=22877): Terminated {rc=256} 03:50:27.316034 --- ParallelTerminationStrategy: PID 22880 died... 03:50:27.334049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22880): Terminated: ok {rc=0} 03:50:27.377291 --- ParallelTerminationStrategy: PID 22883 died... 03:50:27.395348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22883): Terminated: ok {rc=0} 03:50:27.439059 --- ParallelTerminationStrategy: PID 22886 died... 03:50:27.457355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22886): Terminated: ok {rc=0} 03:50:27.540661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:50:28.687646 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:28.699503 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:28.759504 tst iperf3m4.py: using LAC 25787 03:50:28.880077 tst iperf3m4.py: using RAC 32 03:50:28.995094 tst iperf3m4.py: using CellId 25787 03:50:29.116418 tst iperf3m4.py: using BVCI 25788 03:50:29.223264 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.234278 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.244943 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.255982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.267101 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.278142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.289246 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.299970 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:29.310904 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:29.428412 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:29.544758 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:29.660455 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:29.779646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:50:29.990586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:30.304684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22888): Launched 03:50:30.577589 run iperf3-srv_10.42.42.10(pid=22889): Launched 03:50:30.694632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:50:30.911887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:31.234841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22890): Launched 03:50:31.533741 run iperf3-srv_10.42.42.10(pid=22891): Launched 03:50:31.658055 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:50:31.866293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:32.191068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22892): Launched 03:50:32.466229 run iperf3-srv_10.42.42.10(pid=22893): Launched 03:50:32.583988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:50:32.795055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:33.110201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22894): Launched 03:50:33.382776 run iperf3-srv_10.42.42.10(pid=22895): Launched 03:50:33.499717 tst iperf3m4.py:8: start network... 03:50:33.711250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:34.196697 run create_hlr_db(pid=22896): Launched 03:50:34.324527 bus /gobi_6: Setting Powered False 03:50:35.387377 run create_hlr_db(pid=22896): Terminated: ok {rc=0} 03:50:35.806513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22898): Launched 03:50:36.099820 run osmo-hlr_10.42.42.2(pid=22899): Launched 03:50:36.211647 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:36.718047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22901): Launched 03:50:37.012465 run osmo-stp_10.42.42.5(pid=22902): Launched 03:50:37.124562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:37.632033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22904): Launched 03:50:37.744723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:37.993576 run patchelf(pid=22905): Launched 03:50:38.156268 run osmo-stp_10.42.42.5(pid=22902): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22902)] 03:50:38.281204 run osmo-stp_10.42.42.5(pid=22902): stdout: | (launched: 2022-12-10_03:50:36.958086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:38.407771 run osmo-stp_10.42.42.5(pid=22902): stderr: | 20221210035037129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035037129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035037129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035037130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035037130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035037130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035037130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:38.533965 run osmo-stp_10.42.42.5(pid=22902): stdout: | (launched: 2022-12-10_03:50:36.958086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:38.655254 run osmo-stp_10.42.42.5(pid=22902): stderr: | 20221210035037129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035037129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035037129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035037130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035037130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035037130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035037130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:38.798099 run patchelf(pid=22905): Terminating (SIGINT) 03:50:38.963390 run patchelf(pid=22905): Terminated: ok {rc=0} 03:50:39.082746 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22902): Process ended prematurely: osmo-stp_10.42.42.5(pid=22902) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22902)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:50:39.092530 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:50:39.120805 run osmo-hlr_10.42.42.2(pid=22899): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22899)] 03:50:39.168691 run osmo-hlr_10.42.42.2(pid=22899): stdout: | (launched: 2022-12-10_03:50:36.045722) 03:50:39.217915 run osmo-hlr_10.42.42.2(pid=22899): stderr: | 20221210035036223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035036223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035036223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035036223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035036223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035036223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035036236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035036244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035036244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035036244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:39.267738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22888): Terminating (SIGTERM) 03:50:39.307721 run iperf3-srv_10.42.42.10(pid=22889): Terminating (SIGTERM) 03:50:39.347781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22890): Terminating (SIGTERM) 03:50:39.387647 run iperf3-srv_10.42.42.10(pid=22891): Terminating (SIGTERM) 03:50:39.427433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22892): Terminating (SIGTERM) 03:50:39.467380 run iperf3-srv_10.42.42.10(pid=22893): Terminating (SIGTERM) 03:50:39.507069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22894): Terminating (SIGTERM) 03:50:39.546931 run iperf3-srv_10.42.42.10(pid=22895): Terminating (SIGTERM) 03:50:39.586556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22898): Terminating (SIGTERM) 03:50:39.626367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22901): Terminating (SIGTERM) 03:50:39.666533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22904): Terminating (SIGTERM) 03:50:39.706679 --- ParallelTerminationStrategy: PID 22888 died... 03:50:39.725568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22888): Terminated: ok {rc=0} 03:50:39.769967 --- ParallelTerminationStrategy: PID 22889 died... 03:50:39.788404 run iperf3-srv_10.42.42.10(pid=22889): Terminated {rc=256} 03:50:39.832496 --- ParallelTerminationStrategy: PID 22890 died... 03:50:39.850874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22890): Terminated: ok {rc=0} 03:50:39.895610 --- ParallelTerminationStrategy: PID 22891 died... 03:50:39.914120 run iperf3-srv_10.42.42.10(pid=22891): Terminated {rc=256} 03:50:39.957659 --- ParallelTerminationStrategy: PID 22892 died... 03:50:39.975862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22892): Terminated: ok {rc=0} 03:50:40.019567 --- ParallelTerminationStrategy: PID 22893 died... 03:50:40.037982 run iperf3-srv_10.42.42.10(pid=22893): Terminated {rc=256} 03:50:40.081602 --- ParallelTerminationStrategy: PID 22894 died... 03:50:40.099948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22894): Terminated: ok {rc=0} 03:50:40.143618 --- ParallelTerminationStrategy: PID 22895 died... 03:50:40.161952 run iperf3-srv_10.42.42.10(pid=22895): Terminated {rc=256} 03:50:40.205602 --- ParallelTerminationStrategy: PID 22898 died... 03:50:40.223948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22898): Terminated: ok {rc=0} 03:50:40.267585 --- ParallelTerminationStrategy: PID 22901 died... 03:50:40.286086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22901): Terminated: ok {rc=0} 03:50:40.329663 --- ParallelTerminationStrategy: PID 22904 died... 03:50:40.347902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22904): Terminated: ok {rc=0} 03:50:40.433243 bus /gobi_4: Setting Powered False 03:50:41.530853 bus /gobi_4: Setting Powered False 03:50:42.645366 bus /gobi_1: Setting Powered False 03:50:43.743238 bus /gobi_1: Setting Powered False 03:50:44.858894 bus /gobi_0: Setting Powered False 03:50:45.961238 bus /gobi_0: Setting Powered False 03:50:47.082132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:50:48.196924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.208325 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:48.264745 tst ping.py: using LAC 25788 03:50:48.381134 tst ping.py: using RAC 33 03:50:48.494290 tst ping.py: using CellId 25788 03:50:48.606882 tst ping.py: using BVCI 25789 03:50:48.711372 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.722405 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.733121 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.743760 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.754770 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.765639 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.776656 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:48.787770 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:48.902860 tst ping.py:19: start network... 03:50:49.111645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:49.588377 run create_hlr_db(pid=22906): Launched 03:50:49.715994 bus /gobi_6: Setting Powered False 03:50:50.776624 run create_hlr_db(pid=22906): Terminated: ok {rc=0} 03:50:51.189394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22908): Launched 03:50:51.476262 run osmo-hlr_10.42.42.2(pid=22909): Launched 03:50:51.585944 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:52.097858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22911): Launched 03:50:52.385317 run osmo-stp_10.42.42.5(pid=22912): Launched 03:50:52.494947 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:52.995446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22914): Launched 03:50:53.105603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:53.349214 run patchelf(pid=22915): Launched 03:50:53.509167 run osmo-stp_10.42.42.5(pid=22912): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22912)] 03:50:53.631904 run osmo-stp_10.42.42.5(pid=22912): stdout: | (launched: 2022-12-10_03:50:52.332375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:53.756457 run osmo-stp_10.42.42.5(pid=22912): stderr: | 20221210035052500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035052500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035052501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035052501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035052501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035052502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035052502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:53.880759 run osmo-stp_10.42.42.5(pid=22912): stdout: | (launched: 2022-12-10_03:50:52.332375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:53.999066 run osmo-stp_10.42.42.5(pid=22912): stderr: | 20221210035052500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035052500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035052501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035052501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035052501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035052502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035052502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:54.139754 run patchelf(pid=22915): Terminating (SIGINT) 03:50:54.302354 run patchelf(pid=22915): Terminated: ok {rc=0} 03:50:54.419804 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22912): Process ended prematurely: osmo-stp_10.42.42.5(pid=22912) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22912)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 03:50:54.429084 tst ping.py:22: Test FAILED (6.2 sec) 03:50:54.456302 run osmo-hlr_10.42.42.2(pid=22909): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22909)] 03:50:54.503488 run osmo-hlr_10.42.42.2(pid=22909): stdout: | (launched: 2022-12-10_03:50:51.423180) 03:50:54.552793 run osmo-hlr_10.42.42.2(pid=22909): stderr: | 20221210035051598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035051598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035051598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035051598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035051598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035051598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035051610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035051618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035051618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035051618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:54.602282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22908): Terminating (SIGTERM) 03:50:54.641950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22911): Terminating (SIGTERM) 03:50:54.681963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22914): Terminating (SIGTERM) 03:50:54.722023 --- ParallelTerminationStrategy: PID 22908 died... 03:50:54.741155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22908): Terminated: ok {rc=0} 03:50:54.785280 --- ParallelTerminationStrategy: PID 22911 died... 03:50:54.803603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22911): Terminated: ok {rc=0} 03:50:54.847883 --- ParallelTerminationStrategy: PID 22914 died... 03:50:54.866492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22914): Terminated: ok {rc=0} 03:50:54.951184 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:50:56.038701 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.050198 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:56.107082 tst ping_idle_ping.py: using LAC 25789 03:50:56.222406 tst ping_idle_ping.py: using RAC 34 03:50:56.336347 tst ping_idle_ping.py: using CellId 25789 03:50:56.449884 tst ping_idle_ping.py: using BVCI 25790 03:50:56.563122 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.574636 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.585974 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.597312 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.608325 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.619651 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.631014 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:56.642158 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:56.754076 tst ping_idle_ping.py:24: start network... 03:50:56.947773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:57.397615 run create_hlr_db(pid=22916): Launched 03:50:57.507797 bus /gobi_6: Setting Powered False 03:50:58.566823 run create_hlr_db(pid=22916): Terminated: ok {rc=0} 03:50:58.991109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22918): Launched 03:50:59.299614 run osmo-hlr_10.42.42.2(pid=22919): Launched 03:50:59.417396 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:59.948658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22921): Launched 03:51:00.257429 run osmo-stp_10.42.42.5(pid=22922): Launched 03:51:00.375269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:00.926698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22924): Launched 03:51:01.056876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:01.329499 run patchelf(pid=22925): Launched 03:51:01.515353 run osmo-stp_10.42.42.5(pid=22922): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22922)] 03:51:01.648807 run osmo-stp_10.42.42.5(pid=22922): stdout: | (launched: 2022-12-10_03:51:00.200808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:01.783635 run osmo-stp_10.42.42.5(pid=22922): stderr: | 20221210035100392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035100392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035100392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035100393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035100393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035100393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035100393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:01.915083 run osmo-stp_10.42.42.5(pid=22922): stdout: | (launched: 2022-12-10_03:51:00.200808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:02.038584 run osmo-stp_10.42.42.5(pid=22922): stderr: | 20221210035100392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035100392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035100392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035100393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035100393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035100393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035100393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:02.184312 run patchelf(pid=22925): Terminating (SIGINT) 03:51:02.350608 run patchelf(pid=22925): Terminated: ok {rc=0} 03:51:02.468515 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22922): Process ended prematurely: osmo-stp_10.42.42.5(pid=22922) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22922)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:51:02.477656 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:51:02.504722 run osmo-hlr_10.42.42.2(pid=22919): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22919)] 03:51:02.552559 run osmo-hlr_10.42.42.2(pid=22919): stdout: | (launched: 2022-12-10_03:50:59.243179) 03:51:02.601944 run osmo-hlr_10.42.42.2(pid=22919): stderr: | 20221210035059440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035059440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035059440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035059440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035059440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035059441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035059453 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035059462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035059463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035059463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:02.651516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22918): Terminating (SIGTERM) 03:51:02.691579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22921): Terminating (SIGTERM) 03:51:02.731355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22924): Terminating (SIGTERM) 03:51:02.770952 --- ParallelTerminationStrategy: PID 22918 died... 03:51:02.789925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22918): Terminated: ok {rc=0} 03:51:02.834132 --- ParallelTerminationStrategy: PID 22921 died... 03:51:02.852601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22921): Terminated: ok {rc=0} 03:51:02.896280 --- ParallelTerminationStrategy: PID 22924 died... 03:51:02.914912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22924): Terminated: ok {rc=0} 03:51:03.001420 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:51:04.299084 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:51:04.305527 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:51:04.326571 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:51:04.366767 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:51:04.454313 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:51:04.475466 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:51:04.515257 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:51:05.110827 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:51:05.161928 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.173477 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:05.232003 tst cs_paging_gprs_active.py: using LAC 25790 03:51:05.356254 tst cs_paging_gprs_active.py: using RAC 35 03:51:05.478746 tst cs_paging_gprs_active.py: using CellId 25790 03:51:05.601158 tst cs_paging_gprs_active.py: using BVCI 25791 03:51:05.714150 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.725713 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.736832 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.748188 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.759369 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.770777 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.782186 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.793514 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:05.804843 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:05.921356 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:06.035999 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:51:06.234346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:06.529905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22930): Launched 03:51:06.785837 run iperf3-srv_10.42.42.10(pid=22931): Launched 03:51:06.895906 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:51:07.092768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:07.387735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22932): Launched 03:51:07.642954 run iperf3-srv_10.42.42.10(pid=22933): Launched 03:51:07.752630 tst cs_paging_gprs_active.py:38: start network... 03:51:07.949549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:08.404212 run create_hlr_db(pid=22934): Launched 03:51:08.517443 bus /gobi_6: Setting Powered False 03:51:09.575926 run create_hlr_db(pid=22934): Terminated: ok {rc=0} 03:51:10.005502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22936): Launched 03:51:10.319417 run osmo-hlr_10.42.42.2(pid=22937): Launched 03:51:10.439030 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:10.983624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22939): Launched 03:51:11.297731 run osmo-stp_10.42.42.5(pid=22940): Launched 03:51:11.417105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:11.958155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22942): Launched 03:51:12.077376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:12.342172 run patchelf(pid=22943): Launched 03:51:12.516354 run osmo-stp_10.42.42.5(pid=22940): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22940)] 03:51:12.650521 run osmo-stp_10.42.42.5(pid=22940): stdout: | (launched: 2022-12-10_03:51:11.240541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:12.785373 run osmo-stp_10.42.42.5(pid=22940): stderr: | 20221210035111434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035111434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035111434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035111434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035111435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035111435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035111435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:12.920567 run osmo-stp_10.42.42.5(pid=22940): stdout: | (launched: 2022-12-10_03:51:11.240541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:13.049208 run osmo-stp_10.42.42.5(pid=22940): stderr: | 20221210035111434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035111434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035111434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035111434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035111435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035111435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035111435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:13.201989 run patchelf(pid=22943): Terminating (SIGINT) 03:51:13.378358 run patchelf(pid=22943): Terminated: ok {rc=0} 03:51:13.505558 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22940): Process ended prematurely: osmo-stp_10.42.42.5(pid=22940) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22940)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:51:13.516029 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:51:13.544514 run osmo-hlr_10.42.42.2(pid=22937): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22937)] 03:51:13.593781 run osmo-hlr_10.42.42.2(pid=22937): stdout: | (launched: 2022-12-10_03:51:10.262164) 03:51:13.644670 run osmo-hlr_10.42.42.2(pid=22937): stderr: | 20221210035110458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035110458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035110458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035110458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035110459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035110459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035110471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035110481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035110482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035110482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:13.696104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22930): Terminating (SIGTERM) 03:51:13.737317 run iperf3-srv_10.42.42.10(pid=22931): Terminating (SIGTERM) 03:51:13.778512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22932): Terminating (SIGTERM) 03:51:13.819717 run iperf3-srv_10.42.42.10(pid=22933): Terminating (SIGTERM) 03:51:13.861055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22936): Terminating (SIGTERM) 03:51:13.902152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22939): Terminating (SIGTERM) 03:51:13.943675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22942): Terminating (SIGTERM) 03:51:13.985251 --- ParallelTerminationStrategy: PID 22930 died... 03:51:14.004792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22930): Terminated: ok {rc=0} 03:51:14.050747 --- ParallelTerminationStrategy: PID 22931 died... 03:51:14.070008 run iperf3-srv_10.42.42.10(pid=22931): Terminated {rc=256} 03:51:14.116032 --- ParallelTerminationStrategy: PID 22932 died... 03:51:14.135308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22932): Terminated: ok {rc=0} 03:51:14.180812 --- ParallelTerminationStrategy: PID 22933 died... 03:51:14.200406 run iperf3-srv_10.42.42.10(pid=22933): Terminated {rc=256} 03:51:14.245922 --- ParallelTerminationStrategy: PID 22936 died... 03:51:14.265245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22936): Terminated: ok {rc=0} 03:51:14.310537 --- ParallelTerminationStrategy: PID 22939 died... 03:51:14.329820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22939): Terminated: ok {rc=0} 03:51:14.375043 --- ParallelTerminationStrategy: PID 22942 died... 03:51:14.394372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22942): Terminated: ok {rc=0} 03:51:14.480178 bus /gobi_0: Setting Powered False 03:51:15.579308 bus /gobi_0: Setting Powered False 03:51:16.702831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:51:17.863763 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:17.875566 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:17.941273 tst iperf3.py: using LAC 25791 03:51:18.062752 tst iperf3.py: using RAC 36 03:51:18.183488 tst iperf3.py: using CellId 25791 03:51:18.306582 tst iperf3.py: using BVCI 25792 03:51:18.421576 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.433140 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.444100 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.455269 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.466400 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.477701 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.488904 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.499981 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:18.511296 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:18.628298 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:51:18.839507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:19.154093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22944): Launched 03:51:19.425010 run iperf3-srv_10.42.42.10(pid=22945): Launched 03:51:19.541941 tst iperf3.py:8: start network... 03:51:19.752445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:20.247048 run create_hlr_db(pid=22946): Launched 03:51:20.374017 bus /gobi_6: Setting Powered False 03:51:21.435924 run create_hlr_db(pid=22946): Terminated: ok {rc=0} 03:51:21.867781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22948): Launched 03:51:22.178274 run osmo-hlr_10.42.42.2(pid=22949): Launched 03:51:22.296346 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:22.834359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22951): Launched 03:51:23.143524 run osmo-stp_10.42.42.5(pid=22952): Launched 03:51:23.262106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:23.796767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22954): Launched 03:51:23.915839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:24.179034 run patchelf(pid=22955): Launched 03:51:24.352161 run osmo-stp_10.42.42.5(pid=22952): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22952)] 03:51:24.484170 run osmo-stp_10.42.42.5(pid=22952): stdout: | (launched: 2022-12-10_03:51:23.087577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:24.618273 run osmo-stp_10.42.42.5(pid=22952): stderr: | 20221210035123275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035123275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035123275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035123276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035123276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035123276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035123276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:24.752647 run osmo-stp_10.42.42.5(pid=22952): stdout: | (launched: 2022-12-10_03:51:23.087577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:24.880327 run osmo-stp_10.42.42.5(pid=22952): stderr: | 20221210035123275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035123275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035123275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035123276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035123276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035123276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035123276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:25.031951 run patchelf(pid=22955): Terminating (SIGINT) 03:51:25.207115 run patchelf(pid=22955): Terminated: ok {rc=0} 03:51:25.333316 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22952): Process ended prematurely: osmo-stp_10.42.42.5(pid=22952) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22952)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 03:51:25.343809 tst iperf3.py:8: Test FAILED (7.5 sec) 03:51:25.372251 run osmo-hlr_10.42.42.2(pid=22949): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22949)] 03:51:25.421288 run osmo-hlr_10.42.42.2(pid=22949): stdout: | (launched: 2022-12-10_03:51:22.122422) 03:51:25.472129 run osmo-hlr_10.42.42.2(pid=22949): stderr: | 20221210035122319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035122319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035122319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035122319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035122319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035122319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035122332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035122340 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035122341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035122341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:25.524827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22944): Terminating (SIGTERM) 03:51:25.566044 run iperf3-srv_10.42.42.10(pid=22945): Terminating (SIGTERM) 03:51:25.607206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22948): Terminating (SIGTERM) 03:51:25.648470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22951): Terminating (SIGTERM) 03:51:25.689726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22954): Terminating (SIGTERM) 03:51:25.731016 --- ParallelTerminationStrategy: PID 22944 died... 03:51:25.750576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22944): Terminated: ok {rc=0} 03:51:25.796345 --- ParallelTerminationStrategy: PID 22945 died... 03:51:25.815521 run iperf3-srv_10.42.42.10(pid=22945): Terminated {rc=256} 03:51:25.860702 --- ParallelTerminationStrategy: PID 22948 died... 03:51:25.879985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22948): Terminated: ok {rc=0} 03:51:25.925162 --- ParallelTerminationStrategy: PID 22951 died... 03:51:25.944194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22951): Terminated: ok {rc=0} 03:51:25.989953 --- ParallelTerminationStrategy: PID 22954 died... 03:51:26.009323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22954): Terminated: ok {rc=0} 03:51:26.095082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:51:27.242156 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.254086 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:27.313409 tst iperf3m4.py: using LAC 25792 03:51:27.436584 tst iperf3m4.py: using RAC 37 03:51:27.558042 tst iperf3m4.py: using CellId 25792 03:51:27.679587 tst iperf3m4.py: using BVCI 25793 03:51:27.792450 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.803789 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.814803 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.825872 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.836766 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.847763 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.858905 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.869832 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:27.880882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:27.998609 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:28.113691 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:28.229545 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:28.347840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:51:28.546121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:28.839263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22956): Launched 03:51:29.092873 run iperf3-srv_10.42.42.10(pid=22957): Launched 03:51:29.201851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:51:29.396930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:29.688370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22958): Launched 03:51:29.940593 run iperf3-srv_10.42.42.10(pid=22959): Launched 03:51:30.049275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:51:30.244361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:30.535884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22960): Launched 03:51:30.788654 run iperf3-srv_10.42.42.10(pid=22961): Launched 03:51:30.938682 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:51:31.183695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:31.510036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22962): Launched 03:51:31.807445 run iperf3-srv_10.42.42.10(pid=22963): Launched 03:51:31.928770 tst iperf3m4.py:8: start network... 03:51:32.145184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:32.629917 run create_hlr_db(pid=22964): Launched 03:51:32.756554 bus /gobi_6: Setting Powered False 03:51:33.818922 run create_hlr_db(pid=22964): Terminated: ok {rc=0} 03:51:34.253025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22966): Launched 03:51:34.563333 run osmo-hlr_10.42.42.2(pid=22967): Launched 03:51:34.681015 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:35.222183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22969): Launched 03:51:35.532319 run osmo-stp_10.42.42.5(pid=22970): Launched 03:51:35.650505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:36.186970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22972): Launched 03:51:36.305814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:36.567559 run patchelf(pid=22973): Launched 03:51:36.740658 run osmo-stp_10.42.42.5(pid=22970): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22970)] 03:51:36.872888 run osmo-stp_10.42.42.5(pid=22970): stdout: | (launched: 2022-12-10_03:51:35.476194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:37.006755 run osmo-stp_10.42.42.5(pid=22970): stderr: | 20221210035135668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035135668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035135668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035135669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035135669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035135669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035135669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:37.141330 run osmo-stp_10.42.42.5(pid=22970): stdout: | (launched: 2022-12-10_03:51:35.476194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:37.269131 run osmo-stp_10.42.42.5(pid=22970): stderr: | 20221210035135668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035135668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035135668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035135669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035135669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035135669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035135669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:37.419881 run patchelf(pid=22973): Terminating (SIGINT) 03:51:37.594206 run patchelf(pid=22973): Terminated: ok {rc=0} 03:51:37.719875 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22970): Process ended prematurely: osmo-stp_10.42.42.5(pid=22970) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22970)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:51:37.730157 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:51:37.758501 run osmo-hlr_10.42.42.2(pid=22967): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22967)] 03:51:37.807812 run osmo-hlr_10.42.42.2(pid=22967): stdout: | (launched: 2022-12-10_03:51:34.507181) 03:51:37.858811 run osmo-hlr_10.42.42.2(pid=22967): stderr: | 20221210035134704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035134704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035134704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035134704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035134704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035134704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035134719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035134731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035134731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035134731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:37.910318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22956): Terminating (SIGTERM) 03:51:37.951634 run iperf3-srv_10.42.42.10(pid=22957): Terminating (SIGTERM) 03:51:37.993429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22958): Terminating (SIGTERM) 03:51:38.034876 run iperf3-srv_10.42.42.10(pid=22959): Terminating (SIGTERM) 03:51:38.076140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22960): Terminating (SIGTERM) 03:51:38.118003 run iperf3-srv_10.42.42.10(pid=22961): Terminating (SIGTERM) 03:51:38.159359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22962): Terminating (SIGTERM) 03:51:38.200638 run iperf3-srv_10.42.42.10(pid=22963): Terminating (SIGTERM) 03:51:38.241858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22966): Terminating (SIGTERM) 03:51:38.283112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22969): Terminating (SIGTERM) 03:51:38.324432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22972): Terminating (SIGTERM) 03:51:38.365888 --- ParallelTerminationStrategy: PID 22956 died... 03:51:38.385664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22956): Terminated: ok {rc=0} 03:51:38.431512 --- ParallelTerminationStrategy: PID 22957 died... 03:51:38.450815 run iperf3-srv_10.42.42.10(pid=22957): Terminated {rc=256} 03:51:38.495974 --- ParallelTerminationStrategy: PID 22958 died... 03:51:38.514973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22958): Terminated: ok {rc=0} 03:51:38.560137 --- ParallelTerminationStrategy: PID 22959 died... 03:51:38.579241 run iperf3-srv_10.42.42.10(pid=22959): Terminated {rc=256} 03:51:38.624692 --- ParallelTerminationStrategy: PID 22960 died... 03:51:38.643917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22960): Terminated: ok {rc=0} 03:51:38.689126 --- ParallelTerminationStrategy: PID 22961 died... 03:51:38.708206 run iperf3-srv_10.42.42.10(pid=22961): Terminated {rc=256} 03:51:38.753407 --- ParallelTerminationStrategy: PID 22962 died... 03:51:38.772515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22962): Terminated: ok {rc=0} 03:51:38.817418 --- ParallelTerminationStrategy: PID 22963 died... 03:51:38.836620 run iperf3-srv_10.42.42.10(pid=22963): Terminated {rc=256} 03:51:38.881784 --- ParallelTerminationStrategy: PID 22966 died... 03:51:38.901065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22966): Terminated: ok {rc=0} 03:51:38.946112 --- ParallelTerminationStrategy: PID 22969 died... 03:51:38.965391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22969): Terminated: ok {rc=0} 03:51:39.010416 --- ParallelTerminationStrategy: PID 22972 died... 03:51:39.029630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22972): Terminated: ok {rc=0} 03:51:39.115253 bus /gobi_4: Setting Powered False 03:51:40.215697 bus /gobi_4: Setting Powered False 03:51:41.328602 bus /gobi_1: Setting Powered False 03:51:42.424825 bus /gobi_1: Setting Powered False 03:51:43.537715 bus /gobi_0: Setting Powered False 03:51:44.632371 bus /gobi_0: Setting Powered False 03:51:45.747803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:51:46.857089 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:46.873713 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:46.948064 tst ping.py: using LAC 25793 03:51:47.062573 tst ping.py: using RAC 38 03:51:47.216792 tst ping.py: using CellId 25793 03:51:47.338357 tst ping.py: using BVCI 25794 03:51:47.445092 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:47.455934 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:47.466510 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:47.477847 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:47.489376 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:47.500554 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:47.511799 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:47.523226 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:47.638153 tst ping.py:19: start network... 03:51:47.843905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:48.315339 run create_hlr_db(pid=22974): Launched 03:51:48.438877 bus /gobi_6: Setting Powered False 03:51:49.500405 run create_hlr_db(pid=22974): Terminated: ok {rc=0} 03:51:49.926113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22976): Launched 03:51:50.230492 run osmo-hlr_10.42.42.2(pid=22977): Launched 03:51:50.345839 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:50.872244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22979): Launched 03:51:51.177637 run osmo-stp_10.42.42.5(pid=22980): Launched 03:51:51.294564 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:51.820486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22982): Launched 03:51:51.936526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:52.193269 run patchelf(pid=22983): Launched 03:51:52.362643 run osmo-stp_10.42.42.5(pid=22980): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22980)] 03:51:52.492252 run osmo-stp_10.42.42.5(pid=22980): stdout: | (launched: 2022-12-10_03:51:51.122249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:52.623152 run osmo-stp_10.42.42.5(pid=22980): stderr: | 20221210035151309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035151309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035151309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035151310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035151312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035151312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035151312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:52.754300 run osmo-stp_10.42.42.5(pid=22980): stdout: | (launched: 2022-12-10_03:51:51.122249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:52.879439 run osmo-stp_10.42.42.5(pid=22980): stderr: | 20221210035151309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035151309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035151309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035151310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035151312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035151312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035151312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:53.027927 run patchelf(pid=22983): Terminating (SIGINT) 03:51:53.199092 run patchelf(pid=22983): Terminated: ok {rc=0} 03:51:53.322676 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22980): Process ended prematurely: osmo-stp_10.42.42.5(pid=22980) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22980)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 03:51:53.332168 tst ping.py:22: Test FAILED (6.5 sec) 03:51:53.359812 run osmo-hlr_10.42.42.2(pid=22977): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22977)] 03:51:53.408693 run osmo-hlr_10.42.42.2(pid=22977): stdout: | (launched: 2022-12-10_03:51:50.175202) 03:51:53.459143 run osmo-hlr_10.42.42.2(pid=22977): stderr: | 20221210035150371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035150371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035150371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035150371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035150371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035150371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035150386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035150397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035150397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035150397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:53.510401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22976): Terminating (SIGTERM) 03:51:53.551424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22979): Terminating (SIGTERM) 03:51:53.592331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22982): Terminating (SIGTERM) 03:51:53.633593 --- ParallelTerminationStrategy: PID 22976 died... 03:51:53.653334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22976): Terminated: ok {rc=0} 03:51:53.698663 --- ParallelTerminationStrategy: PID 22979 died... 03:51:53.717820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22979): Terminated: ok {rc=0} 03:51:53.763326 --- ParallelTerminationStrategy: PID 22982 died... 03:51:53.782535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22982): Terminated: ok {rc=0} 03:51:53.869315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:51:54.956087 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:54.968312 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:55.028219 tst ping_idle_ping.py: using LAC 25794 03:51:55.155180 tst ping_idle_ping.py: using RAC 39 03:51:55.289706 tst ping_idle_ping.py: using CellId 25794 03:51:55.411566 tst ping_idle_ping.py: using BVCI 25795 03:51:55.522442 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:55.533941 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:55.545088 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:55.556122 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:55.567127 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:55.578197 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:55.589374 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:55.600369 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:55.715628 tst ping_idle_ping.py:24: start network... 03:51:55.922983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:56.406225 run create_hlr_db(pid=22984): Launched 03:51:56.530076 bus /gobi_6: Setting Powered False 03:51:57.588557 run create_hlr_db(pid=22984): Terminated: ok {rc=0} 03:51:58.015300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22986): Launched 03:51:58.321629 run osmo-hlr_10.42.42.2(pid=22987): Launched 03:51:58.438506 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:58.965506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22989): Launched 03:51:59.271779 run osmo-stp_10.42.42.5(pid=22990): Launched 03:51:59.388607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:59.917648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22992): Launched 03:52:00.034487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:00.293393 run patchelf(pid=22993): Launched 03:52:00.463366 run osmo-stp_10.42.42.5(pid=22990): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22990)] 03:52:00.593301 run osmo-stp_10.42.42.5(pid=22990): stdout: | (launched: 2022-12-10_03:51:59.216244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:00.724760 run osmo-stp_10.42.42.5(pid=22990): stderr: | 20221210035159406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035159406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035159407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035159407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035159409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035159410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035159410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:00.871925 run osmo-stp_10.42.42.5(pid=22990): stdout: | (launched: 2022-12-10_03:51:59.216244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:01.006743 run osmo-stp_10.42.42.5(pid=22990): stderr: | 20221210035159406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035159406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035159407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035159407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035159409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035159410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035159410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:01.153413 run patchelf(pid=22993): Terminating (SIGINT) 03:52:01.320599 run patchelf(pid=22993): Terminated: ok {rc=0} 03:52:01.444125 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22990): Process ended prematurely: osmo-stp_10.42.42.5(pid=22990) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22990)] [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:52:01.454255 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:52:01.484187 run osmo-hlr_10.42.42.2(pid=22987): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22987)] 03:52:01.535072 run osmo-hlr_10.42.42.2(pid=22987): stdout: | (launched: 2022-12-10_03:51:58.266582) 03:52:01.586832 run osmo-hlr_10.42.42.2(pid=22987): stderr: | 20221210035158460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035158460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035158460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035158461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035158461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035158461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035158473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035158483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035158483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035158483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:01.639512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22986): Terminating (SIGTERM) 03:52:01.682537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22989): Terminating (SIGTERM) 03:52:01.727272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22992): Terminating (SIGTERM) 03:52:01.771183 --- ParallelTerminationStrategy: PID 22986 died... 03:52:01.790957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22986): Terminated: ok {rc=0} 03:52:01.838808 --- ParallelTerminationStrategy: PID 22989 died... 03:52:01.858396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22989): Terminated: ok {rc=0} 03:52:01.906306 --- ParallelTerminationStrategy: PID 22992 died... 03:52:01.926308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22992): Terminated: ok {rc=0} 03:52:02.019596 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:52:03.322533 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:03.329484 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:52:03.350121 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:52:03.385361 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:52:03.438391 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:52:03.459155 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:52:03.494045 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:52:04.055969 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:52:04.061159 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.072454 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:52:04.128061 tst switch_tch_pdch.py: using LAC 25795 03:52:04.246365 tst switch_tch_pdch.py: using RAC 40 03:52:04.364622 tst switch_tch_pdch.py: using CellId 25795 03:52:04.482387 tst switch_tch_pdch.py: using BVCI 25796 03:52:04.594157 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.605798 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.617094 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.628326 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.639511 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.650796 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.662270 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:04.673536 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:52:04.784649 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:52:04.898766 tst switch_tch_pdch.py:51: start network... 03:52:05.090363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:05.532283 run create_hlr_db(pid=22998): Launched 03:52:05.642030 bus /gobi_6: Setting Powered False 03:52:06.699550 run create_hlr_db(pid=22998): Terminated: ok {rc=0} 03:52:07.118066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23000): Launched 03:52:07.421439 run osmo-hlr_10.42.42.2(pid=23001): Launched 03:52:07.538939 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:08.064374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23003): Launched 03:52:08.368689 run osmo-stp_10.42.42.5(pid=23004): Launched 03:52:08.485580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:09.012755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23006): Launched 03:52:09.129220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:09.386828 run patchelf(pid=23007): Launched 03:52:09.556056 run osmo-stp_10.42.42.5(pid=23004): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23004)] 03:52:09.685360 run osmo-stp_10.42.42.5(pid=23004): stdout: | (launched: 2022-12-10_03:52:08.313946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:09.816527 run osmo-stp_10.42.42.5(pid=23004): stderr: | 20221210035208504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035208504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035208504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035208505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035208506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035208506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035208506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:09.947441 run osmo-stp_10.42.42.5(pid=23004): stdout: | (launched: 2022-12-10_03:52:08.313946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:10.072510 run osmo-stp_10.42.42.5(pid=23004): stderr: | 20221210035208504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035208504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035208504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035208505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035208506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035208506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035208506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:10.221422 run patchelf(pid=23007): Terminating (SIGINT) 03:52:10.392120 run patchelf(pid=23007): Terminated: ok {rc=0} 03:52:10.515284 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23004): Process ended prematurely: osmo-stp_10.42.42.5(pid=23004) [trial-2369↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23004)] [trial-2369↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:52:10.524728 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:52:10.552670 run osmo-hlr_10.42.42.2(pid=23001): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23001)] 03:52:10.601763 run osmo-hlr_10.42.42.2(pid=23001): stdout: | (launched: 2022-12-10_03:52:07.366727) 03:52:10.652323 run osmo-hlr_10.42.42.2(pid=23001): stderr: | 20221210035207563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035207563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035207563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035207563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035207564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035207564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035207579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035207590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035207590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035207590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:10.703356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23000): Terminating (SIGTERM) 03:52:10.744409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23003): Terminating (SIGTERM) 03:52:10.785411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23006): Terminating (SIGTERM) 03:52:10.826553 --- ParallelTerminationStrategy: PID 23000 died... 03:52:10.845875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23000): Terminated: ok {rc=0} 03:52:10.890961 --- ParallelTerminationStrategy: PID 23003 died... 03:52:10.909940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23003): Terminated: ok {rc=0} 03:52:10.954916 --- ParallelTerminationStrategy: PID 23006 died... 03:52:10.973814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23006): Terminated: ok {rc=0} 03:52:11.058408 bus /gobi_0: Setting Powered False 03:52:12.155628 bus /gobi_0: Setting Powered False 03:52:13.269536 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:52:14.499409 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:14.504836 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:52:14.525545 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:52:14.561173 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:52:14.614445 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:52:14.634938 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:52:14.669066 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:52:15.221466 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:52:15.226341 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.237265 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:52:15.293173 tst switch_tch_pdch.py: using LAC 25796 03:52:15.410663 tst switch_tch_pdch.py: using RAC 41 03:52:15.522374 tst switch_tch_pdch.py: using CellId 25796 03:52:15.632005 tst switch_tch_pdch.py: using BVCI 25797 03:52:15.735063 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.745980 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.756475 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.767299 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.778047 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.788615 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.799250 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:15.810000 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:52:15.945718 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:52:16.059754 tst switch_tch_pdch.py:51: start network... 03:52:16.325202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:16.762506 run create_hlr_db(pid=23011): Launched 03:52:16.931452 bus /gobi_6: Setting Powered False 03:52:17.993303 run create_hlr_db(pid=23011): Terminated: ok {rc=0} 03:52:18.391794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23013): Launched 03:52:18.694475 run osmo-hlr_10.42.42.2(pid=23014): Launched 03:52:18.809692 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:19.312490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23016): Launched 03:52:19.616595 run osmo-stp_10.42.42.5(pid=23017): Launched 03:52:19.732930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:20.234199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23019): Launched 03:52:20.350227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:20.607650 run patchelf(pid=23020): Launched 03:52:20.776706 run osmo-stp_10.42.42.5(pid=23017): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23017)] 03:52:20.906272 run osmo-stp_10.42.42.5(pid=23017): stdout: | (launched: 2022-12-10_03:52:19.561796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:21.037217 run osmo-stp_10.42.42.5(pid=23017): stderr: | 20221210035219751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035219752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035219752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035219752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035219755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035219755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035219755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:21.168833 run osmo-stp_10.42.42.5(pid=23017): stdout: | (launched: 2022-12-10_03:52:19.561796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:21.293683 run osmo-stp_10.42.42.5(pid=23017): stderr: | 20221210035219751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035219752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035219752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035219752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035219755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035219755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035219755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:21.442514 run patchelf(pid=23020): Terminating (SIGINT) 03:52:21.612822 run patchelf(pid=23020): Terminated: ok {rc=0} 03:52:21.736009 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23017): Process ended prematurely: osmo-stp_10.42.42.5(pid=23017) [trial-2369↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23017)] [trial-2369↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:52:21.745687 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:52:21.773218 run osmo-hlr_10.42.42.2(pid=23014): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23014)] 03:52:21.823035 run osmo-hlr_10.42.42.2(pid=23014): stdout: | (launched: 2022-12-10_03:52:18.639796) 03:52:21.873926 run osmo-hlr_10.42.42.2(pid=23014): stderr: | 20221210035218835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035218835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035218835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035218835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035218835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035218835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035218848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035218857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035218857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035218858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:21.925588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23013): Terminating (SIGTERM) 03:52:21.966858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23016): Terminating (SIGTERM) 03:52:22.007817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23019): Terminating (SIGTERM) 03:52:22.049052 --- ParallelTerminationStrategy: PID 23013 died... 03:52:22.068658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23013): Terminated: ok {rc=0} 03:52:22.114143 --- ParallelTerminationStrategy: PID 23016 died... 03:52:22.133556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23016): Terminated: ok {rc=0} 03:52:22.179284 --- ParallelTerminationStrategy: PID 23019 died... 03:52:22.198417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23019): Terminated: ok {rc=0} 03:52:22.284078 bus /gobi_0: Setting Powered False 03:52:23.381815 bus /gobi_0: Setting Powered False 03:52:24.496606 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_sms:trx-b200 --------------------------------------------------------------------- 03:52:25.730931 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:25.735469 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 03:52:25.769355 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 03:52:25.776218 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 03:52:25.829477 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 03:52:25.863450 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 03:52:25.870322 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 03:52:26.413783 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 03:52:26.418706 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 03:52:26.429840 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 03:52:26.479418 tst mo_mt_sms.py: using LAC 25797 03:52:26.599308 tst mo_mt_sms.py: using RAC 42 03:52:26.713478 tst mo_mt_sms.py: using CellId 25797 03:52:26.832440 tst mo_mt_sms.py: using BVCI 25798 03:52:26.943804 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 03:52:27.055665 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 03:52:27.165830 tst mo_mt_sms.py:9: start nitb and bts... 03:52:27.358733 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:52:27.944115 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23024): Launched 03:52:28.228761 run osmo-nitb_10.42.42.2(pid=23025): Launched 03:52:28.387741 run osmo-nitb_10.42.42.2(pid=23025): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23025)] 03:52:28.517400 run osmo-nitb_10.42.42.2(pid=23025): stdout: | (launched: 2022-12-10_03:52:28.177391) 03:52:28.648336 run osmo-nitb_10.42.42.2(pid=23025): stderr: | (launched: 2022-12-10_03:52:28.219774) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:52:28.779133 run osmo-nitb_10.42.42.2(pid=23025): stdout: | (launched: 2022-12-10_03:52:28.177391) 03:52:28.904118 run osmo-nitb_10.42.42.2(pid=23025): stderr: | (launched: 2022-12-10_03:52:28.219774) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23025): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23025) [trial-2369↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23025)] 03:52:29.337184 tst osmo-nitb_10.42.42.2(pid=23025): stdout: | (launched: 2022-12-10_03:52:28.177391) 03:52:29.453397 tst osmo-nitb_10.42.42.2(pid=23025): stderr: | (launched: 2022-12-10_03:52:28.219774) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:52:29.589568 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23025): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23025) [trial-2369↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23025)] [trial-2369↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 03:52:29.597989 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 03:52:29.604502 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23024): Terminating (SIGTERM) 03:52:29.813308 --- ParallelTerminationStrategy: PID 23024 died... 03:52:29.833319 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23024): Terminated: ok {rc=0} 03:52:29.918435 bus /sierra_3: Setting Powered False 03:52:31.016223 bus /sierra_3: Setting Powered False 03:52:32.152456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:trx-b200 --------------------------------------------------------------------- 03:52:33.351067 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:33.355552 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 03:52:33.389195 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:52:33.416359 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 03:52:33.470135 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 03:52:33.503980 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:52:33.531275 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 03:52:34.072413 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 03:52:34.077595 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:34.088141 tst sms:trx-b200: Using 1 x bts (candidates: 1) 03:52:34.136358 tst mo_mt_sms.py: using LAC 25798 03:52:34.250604 tst mo_mt_sms.py: using RAC 43 03:52:34.365040 tst mo_mt_sms.py: using CellId 25798 03:52:34.477367 tst mo_mt_sms.py: using BVCI 25799 03:52:34.583447 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:34.594033 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:34.604326 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:34.615007 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:34.625729 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:34.636331 tst sms:trx-b200: Using 1 x modem (candidates: 2) 03:52:34.749779 tst sms:trx-b200: Using 1 x modem (candidates: 2) 03:52:34.863456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:35.306518 run create_hlr_db(pid=23029): Launched 03:52:35.415631 bus /sierra_2: Setting Powered False 03:52:36.473102 run create_hlr_db(pid=23029): Terminated: ok {rc=0} 03:52:36.871937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Launched 03:52:37.156919 run osmo-hlr_10.42.42.2(pid=23032): Launched 03:52:37.267380 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:37.757490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Launched 03:52:38.040352 run osmo-stp_10.42.42.5(pid=23035): Launched 03:52:38.149439 run osmo-msc_10.42.42.6: Starting osmo-msc 03:52:38.666108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23037): Launched 03:52:38.949880 run osmo-msc_10.42.42.6(pid=23038): Launched 03:52:39.109607 run osmo-stp_10.42.42.5(pid=23035): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] 03:52:39.230950 run osmo-stp_10.42.42.5(pid=23035): stdout: | (launched: 2022-12-10_03:52:37.988718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:39.352936 run osmo-stp_10.42.42.5(pid=23035): stderr: | 20221210035238156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035238157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035238157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035238157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035238158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035238158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035238158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:39.472077 run osmo-stp_10.42.42.5(pid=23035): stdout: | (launched: 2022-12-10_03:52:37.988718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:39.586491 run osmo-stp_10.42.42.5(pid=23035): stderr: | 20221210035238156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035238157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035238157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035238157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035238158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035238158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035238158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:39.722838 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23035): Process ended prematurely: osmo-stp_10.42.42.5(pid=23035) [trial-2369↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] [trial-2369↪sms:trx-b200↪mo_mt_sms.py:16] 03:52:39.731047 tst mo_mt_sms.py:16: Test FAILED (5.6 sec) 03:52:39.757266 run osmo-hlr_10.42.42.2(pid=23032): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23032)] 03:52:39.804567 run osmo-hlr_10.42.42.2(pid=23032): stdout: | (launched: 2022-12-10_03:52:37.105524) 03:52:39.853584 run osmo-hlr_10.42.42.2(pid=23032): stderr: | 20221210035237279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035237280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035237280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035237280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035237280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035237280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035237292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035237300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035237300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035237301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:39.921784 run osmo-msc_10.42.42.6(pid=23038): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23038)] 03:52:39.969108 run osmo-msc_10.42.42.6(pid=23038): stdout: | (launched: 2022-12-10_03:52:38.898322) 03:52:40.017687 run osmo-msc_10.42.42.6(pid=23038): stderr: | 20221210035239166 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035239166 DLGLOBAL DEBUG validating counter group 0x7f4303c63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035239166 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035239166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035239166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035239166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035239168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035239168 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035239169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035239169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:52:40.066749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Terminating (SIGTERM) 03:52:40.105876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Terminating (SIGTERM) 03:52:40.145250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23037): Terminating (SIGTERM) 03:52:40.184747 --- ParallelTerminationStrategy: PID 23031 died... 03:52:40.203594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Terminated: ok {rc=0} 03:52:40.247473 --- ParallelTerminationStrategy: PID 23034 died... 03:52:40.265742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Terminated: ok {rc=0} 03:52:40.309619 --- ParallelTerminationStrategy: PID 23037 died... 03:52:40.327991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23037): Terminated: ok {rc=0} 03:52:40.413213 bus /sierra_3: Setting Powered False 03:52:41.511093 bus /sierra_3: Setting Powered False 03:52:42.626165 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-b200 --------------------------------------------------------------------- 03:52:43.850809 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:43.854458 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 03:52:43.887379 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 03:52:43.893988 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 03:52:43.928294 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 03:52:43.961831 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 03:52:43.968637 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 03:52:44.489380 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 03:52:44.495005 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 03:52:44.506552 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 03:52:44.555404 tst assert_extension.py: using LAC 25799 03:52:44.677239 tst assert_extension.py: using RAC 44 03:52:44.796508 tst assert_extension.py: using CellId 25799 03:52:44.915970 tst assert_extension.py: using BVCI 25800 03:52:45.026545 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 03:52:45.142381 tst assert_extension.py:10: start nitb and bts... 03:52:45.348349 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:52:45.999313 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23043): Launched 03:52:46.325600 run osmo-nitb_10.42.42.2(pid=23044): Launched 03:52:46.489858 run osmo-nitb_10.42.42.2(pid=23044): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] 03:52:46.625117 run osmo-nitb_10.42.42.2(pid=23044): stdout: | (launched: 2022-12-10_03:52:46.257989) 03:52:46.775106 run osmo-nitb_10.42.42.2(pid=23044): stderr: | (launched: 2022-12-10_03:52:46.300752) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:52:46.926031 run osmo-nitb_10.42.42.2(pid=23044): stdout: | (launched: 2022-12-10_03:52:46.257989) 03:52:47.069557 run osmo-nitb_10.42.42.2(pid=23044): stderr: | (launched: 2022-12-10_03:52:46.300752) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23044): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23044) [trial-2369↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] 03:52:47.437973 tst osmo-nitb_10.42.42.2(pid=23044): stdout: | (launched: 2022-12-10_03:52:46.257989) 03:52:47.554027 tst osmo-nitb_10.42.42.2(pid=23044): stderr: | (launched: 2022-12-10_03:52:46.300752) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:52:47.691699 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23044): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23044) [trial-2369↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] [trial-2369↪nitb_ussd:trx-b200↪assert_extension.py:12] 03:52:47.700192 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:52:47.706827 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23043): Terminating (SIGTERM) 03:52:47.917246 --- ParallelTerminationStrategy: PID 23043 died... 03:52:47.937448 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23043): Terminated: ok {rc=0} 03:52:48.023318 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:trx-b200 --------------------------------------------------------------------- 03:52:49.200825 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:49.205164 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 03:52:49.239820 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:52:49.266678 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 03:52:49.302689 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 03:52:49.337229 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:52:49.364218 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 03:52:49.887801 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:trx-b200 assert_extension.py ---------------------------------------------- 03:52:49.892824 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:49.903425 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 03:52:49.951026 tst assert_extension.py: using LAC 25800 03:52:50.066191 tst assert_extension.py: using RAC 45 03:52:50.186012 tst assert_extension.py: using CellId 25800 03:52:50.306222 tst assert_extension.py: using BVCI 25801 03:52:50.417516 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:50.428576 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:50.439626 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:50.450809 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:50.461970 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:52:50.473069 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 03:52:50.588573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:51.062380 run create_hlr_db(pid=23048): Launched 03:52:51.186639 bus /sierra_2: Setting Powered False 03:52:52.247869 run create_hlr_db(pid=23048): Terminated: ok {rc=0} 03:52:52.659435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23050): Launched 03:52:52.945603 run osmo-hlr_10.42.42.2(pid=23051): Launched 03:52:53.054373 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:53.546910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23053): Launched 03:52:53.832814 run osmo-stp_10.42.42.5(pid=23054): Launched 03:52:53.942027 run osmo-msc_10.42.42.6: Starting osmo-msc 03:52:54.458564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23056): Launched 03:52:54.742437 run osmo-msc_10.42.42.6(pid=23057): Launched 03:52:54.902028 run osmo-stp_10.42.42.5(pid=23054): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23054)] 03:52:55.023586 run osmo-stp_10.42.42.5(pid=23054): stdout: | (launched: 2022-12-10_03:52:53.780670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:55.146215 run osmo-stp_10.42.42.5(pid=23054): stderr: | 20221210035253948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035253948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035253948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035253948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035253951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035253951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035253951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:55.265853 run osmo-stp_10.42.42.5(pid=23054): stdout: | (launched: 2022-12-10_03:52:53.780670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:55.380717 run osmo-stp_10.42.42.5(pid=23054): stderr: | 20221210035253948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035253948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035253948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035253948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035253951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035253951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035253951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:55.517575 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23054): Process ended prematurely: osmo-stp_10.42.42.5(pid=23054) [trial-2369↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23054)] [trial-2369↪ussd:trx-b200↪assert_extension.py:17] 03:52:55.525956 tst assert_extension.py:17: Test FAILED (5.6 sec) 03:52:55.551911 run osmo-hlr_10.42.42.2(pid=23051): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23051)] 03:52:55.599157 run osmo-hlr_10.42.42.2(pid=23051): stdout: | (launched: 2022-12-10_03:52:52.894004) 03:52:55.647808 run osmo-hlr_10.42.42.2(pid=23051): stderr: | 20221210035253066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035253066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035253066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035253066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035253066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035253066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035253078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035253087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035253087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035253087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:55.715810 run osmo-msc_10.42.42.6(pid=23057): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23057)] 03:52:55.762907 run osmo-msc_10.42.42.6(pid=23057): stdout: | (launched: 2022-12-10_03:52:54.690642) 03:52:55.811464 run osmo-msc_10.42.42.6(pid=23057): stderr: | 20221210035254959 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035254959 DLGLOBAL DEBUG validating counter group 0x7f03ad981c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035254959 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035254960 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035254960 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035254960 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035254962 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035254962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035254962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035254962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:52:55.860656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23050): Terminating (SIGTERM) 03:52:55.899717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23053): Terminating (SIGTERM) 03:52:55.938911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23056): Terminating (SIGTERM) 03:52:55.978206 --- ParallelTerminationStrategy: PID 23050 died... 03:52:55.996890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23050): Terminated: ok {rc=0} 03:52:56.040341 --- ParallelTerminationStrategy: PID 23053 died... 03:52:56.058513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23053): Terminated: ok {rc=0} 03:52:56.101781 --- ParallelTerminationStrategy: PID 23056 died... 03:52:56.119906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23056): Terminated: ok {rc=0} 03:52:56.205782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:52:57.413776 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:57.420072 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:52:57.454347 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:52:57.480413 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:52:57.536843 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:52:57.570947 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:52:57.598282 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:52:58.146404 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:52:58.197695 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:52:58.209306 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:52:58.279265 tst mo_mt_call.py: using LAC 25801 03:52:58.403891 tst mo_mt_call.py: using RAC 46 03:52:58.526485 tst mo_mt_call.py: using CellId 25801 03:52:58.648343 tst mo_mt_call.py: using BVCI 25802 03:52:58.762996 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:52:58.774665 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:52:58.786180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:52:58.798004 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:52:58.809827 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:52:58.821459 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:52:58.934193 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:52:59.050846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:59.534642 run create_hlr_db(pid=23062): Launched 03:52:59.661101 bus /sierra_2: Setting Powered False 03:53:00.723390 run create_hlr_db(pid=23062): Terminated: ok {rc=0} 03:53:01.183479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23064): Launched 03:53:01.503441 run osmo-hlr_10.42.42.2(pid=23065): Launched 03:53:01.755546 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:02.475041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23067): Launched 03:53:02.786316 run osmo-stp_10.42.42.5(pid=23068): Launched 03:53:02.904168 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:03.467322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23070): Launched 03:53:03.778941 run osmo-msc_10.42.42.6(pid=23071): Launched 03:53:03.951468 run osmo-stp_10.42.42.5(pid=23068): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23068)] 03:53:04.082945 run osmo-stp_10.42.42.5(pid=23068): stdout: | (launched: 2022-12-10_03:53:02.729236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:04.215058 run osmo-stp_10.42.42.5(pid=23068): stderr: | 20221210035302920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035302920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035302921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035302921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035302922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035302922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035302922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:04.346017 run osmo-stp_10.42.42.5(pid=23068): stdout: | (launched: 2022-12-10_03:53:02.729236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:04.470224 run osmo-stp_10.42.42.5(pid=23068): stderr: | 20221210035302920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035302920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035302921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035302921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035302922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035302922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035302922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:04.618967 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23068): Process ended prematurely: osmo-stp_10.42.42.5(pid=23068) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23068)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:53:04.628674 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 03:53:04.656554 run osmo-hlr_10.42.42.2(pid=23065): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23065)] 03:53:04.706264 run osmo-hlr_10.42.42.2(pid=23065): stdout: | (launched: 2022-12-10_03:53:01.442992) 03:53:04.757645 run osmo-hlr_10.42.42.2(pid=23065): stderr: | 20221210035301713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035301713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035301713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035301713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035301713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035301713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035301729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035301747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035301748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035301748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:04.829108 run osmo-msc_10.42.42.6(pid=23071): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23071)] 03:53:04.878882 run osmo-msc_10.42.42.6(pid=23071): stdout: | (launched: 2022-12-10_03:53:03.722270) 03:53:04.930383 run osmo-msc_10.42.42.6(pid=23071): stderr: | 20221210035304042 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035304043 DLGLOBAL DEBUG validating counter group 0x7fccff361c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035304043 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035304043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035304043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035304043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035304046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035304046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035304047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035304047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:04.981931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23064): Terminating (SIGTERM) 03:53:05.023174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23067): Terminating (SIGTERM) 03:53:05.064457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23070): Terminating (SIGTERM) 03:53:05.106049 --- ParallelTerminationStrategy: PID 23064 died... 03:53:05.125726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23064): Terminated: ok {rc=0} 03:53:05.172026 --- ParallelTerminationStrategy: PID 23067 died... 03:53:05.191516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23067): Terminated: ok {rc=0} 03:53:05.237408 --- ParallelTerminationStrategy: PID 23070 died... 03:53:05.256763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23070): Terminated: ok {rc=0} 03:53:05.344131 bus /sierra_3: Setting Powered False 03:53:06.442916 bus /sierra_3: Setting Powered False 03:53:07.558420 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:53:08.705245 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:08.717327 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:53:08.790305 tst mo_mt_call_osmux.py: using LAC 25802 03:53:08.911247 tst mo_mt_call_osmux.py: using RAC 47 03:53:09.031439 tst mo_mt_call_osmux.py: using CellId 25802 03:53:09.152045 tst mo_mt_call_osmux.py: using BVCI 25803 03:53:09.267007 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:09.278530 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:09.289748 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:09.301125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:09.312581 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:09.324075 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:09.440286 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:09.558183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:10.038693 run create_hlr_db(pid=23073): Launched 03:53:10.165349 bus /sierra_2: Setting Powered False 03:53:11.226511 run create_hlr_db(pid=23073): Terminated: ok {rc=0} 03:53:11.643017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23075): Launched 03:53:11.934778 run osmo-hlr_10.42.42.2(pid=23076): Launched 03:53:12.045415 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:12.545464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23078): Launched 03:53:12.835147 run osmo-stp_10.42.42.5(pid=23079): Launched 03:53:12.946211 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:13.473160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23081): Launched 03:53:13.763437 run osmo-msc_10.42.42.6(pid=23082): Launched 03:53:13.926353 run osmo-stp_10.42.42.5(pid=23079): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23079)] 03:53:14.049548 run osmo-stp_10.42.42.5(pid=23079): stdout: | (launched: 2022-12-10_03:53:12.782761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:14.174092 run osmo-stp_10.42.42.5(pid=23079): stderr: | 20221210035312950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035312950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035312950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035312951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035312951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035312951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035312951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:14.295835 run osmo-stp_10.42.42.5(pid=23079): stdout: | (launched: 2022-12-10_03:53:12.782761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:14.411514 run osmo-stp_10.42.42.5(pid=23079): stderr: | 20221210035312950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035312950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035312950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035312951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035312951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035312951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035312951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:14.549935 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23079): Process ended prematurely: osmo-stp_10.42.42.5(pid=23079) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23079)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:53:14.558746 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 03:53:14.585050 run osmo-hlr_10.42.42.2(pid=23076): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23076)] 03:53:14.632350 run osmo-hlr_10.42.42.2(pid=23076): stdout: | (launched: 2022-12-10_03:53:11.881764) 03:53:14.681799 run osmo-hlr_10.42.42.2(pid=23076): stderr: | 20221210035312056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035312056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035312057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035312057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035312057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035312057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035312068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035312077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035312077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035312077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:14.750189 run osmo-msc_10.42.42.6(pid=23082): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23082)] 03:53:14.797328 run osmo-msc_10.42.42.6(pid=23082): stdout: | (launched: 2022-12-10_03:53:13.711134) 03:53:14.846262 run osmo-msc_10.42.42.6(pid=23082): stderr: | 20221210035313979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035313980 DLGLOBAL DEBUG validating counter group 0x7faa3b0bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035313980 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035313980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035313980 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035313980 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035313982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035313982 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035313983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035313983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:14.895421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23075): Terminating (SIGTERM) 03:53:14.934705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23078): Terminating (SIGTERM) 03:53:14.974266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23081): Terminating (SIGTERM) 03:53:15.013881 --- ParallelTerminationStrategy: PID 23075 died... 03:53:15.032552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23075): Terminated: ok {rc=0} 03:53:15.076275 --- ParallelTerminationStrategy: PID 23078 died... 03:53:15.094477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23078): Terminated: ok {rc=0} 03:53:15.138123 --- ParallelTerminationStrategy: PID 23081 died... 03:53:15.156412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23081): Terminated: ok {rc=0} 03:53:15.240701 bus /sierra_3: Setting Powered False 03:53:16.359861 bus /sierra_3: Setting Powered False 03:53:17.506961 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:53:18.775807 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:18.782924 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:53:18.820375 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:53:18.849314 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:53:18.901172 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:53:18.936927 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:53:18.967596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:53:19.512181 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:53:19.563524 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:19.575625 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:53:19.646439 tst mo_mt_call.py: using LAC 25803 03:53:19.765737 tst mo_mt_call.py: using RAC 48 03:53:19.885769 tst mo_mt_call.py: using CellId 25803 03:53:20.005276 tst mo_mt_call.py: using BVCI 25804 03:53:20.113874 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:20.128745 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:20.142817 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:20.154686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:20.167567 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:20.180316 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:53:20.298578 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:53:20.413783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:20.884104 run create_hlr_db(pid=23358): Launched 03:53:21.045023 bus /sierra_2: Setting Powered False 03:53:22.107581 run create_hlr_db(pid=23358): Terminated: ok {rc=0} 03:53:22.559386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23360): Launched 03:53:22.905021 run osmo-hlr_10.42.42.2(pid=23361): Launched 03:53:23.159916 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:23.827130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23363): Launched 03:53:24.171458 run osmo-stp_10.42.42.5(pid=23364): Launched 03:53:24.416014 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:25.102094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23366): Launched 03:53:25.447811 run osmo-msc_10.42.42.6(pid=23367): Launched 03:53:25.813268 run osmo-stp_10.42.42.5(pid=23364): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23364)] 03:53:26.097937 run osmo-stp_10.42.42.5(pid=23364): stdout: | (launched: 2022-12-10_03:53:24.109303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:26.274628 run osmo-stp_10.42.42.5(pid=23364): stderr: | 20221210035324407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035324407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035324407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035324408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035324418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035324418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035324418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:26.413543 run osmo-stp_10.42.42.5(pid=23364): stdout: | (launched: 2022-12-10_03:53:24.109303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:26.545724 run osmo-stp_10.42.42.5(pid=23364): stderr: | 20221210035324407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035324407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035324407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035324408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035324418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035324418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035324418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:26.703826 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23364): Process ended prematurely: osmo-stp_10.42.42.5(pid=23364) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23364)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:53:26.714588 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 03:53:26.745211 run osmo-hlr_10.42.42.2(pid=23361): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23361)] 03:53:26.797478 run osmo-hlr_10.42.42.2(pid=23361): stdout: | (launched: 2022-12-10_03:53:22.839004) 03:53:26.851229 run osmo-hlr_10.42.42.2(pid=23361): stderr: | 20221210035323154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035323154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035323154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035323154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035323154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035323154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035323175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035323191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035323192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035323192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:26.924873 run osmo-msc_10.42.42.6(pid=23367): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23367)] 03:53:26.979281 run osmo-msc_10.42.42.6(pid=23367): stdout: | (launched: 2022-12-10_03:53:25.384216) 03:53:27.032512 run osmo-msc_10.42.42.6(pid=23367): stderr: | 20221210035325892 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035325892 DLGLOBAL DEBUG validating counter group 0x7ff0db324c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035325892 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035325892 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035325892 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035325892 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035325903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035325903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035325903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035325903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:27.086775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23360): Terminating (SIGTERM) 03:53:27.130276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23363): Terminating (SIGTERM) 03:53:27.176676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23366): Terminating (SIGTERM) 03:53:27.222461 --- ParallelTerminationStrategy: PID 23360 died... 03:53:27.243745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23360): Terminated: ok {rc=0} 03:53:27.292936 --- ParallelTerminationStrategy: PID 23363 died... 03:53:27.313934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23363): Terminated: ok {rc=0} 03:53:27.363288 --- ParallelTerminationStrategy: PID 23366 died... 03:53:27.383845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23366): Terminated: ok {rc=0} 03:53:27.473891 bus /sierra_3: Setting Powered False 03:53:28.574629 bus /sierra_3: Setting Powered False 03:53:29.691839 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:53:30.847225 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:30.860549 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:53:30.939962 tst mo_mt_call_osmux.py: using LAC 25804 03:53:31.079007 tst mo_mt_call_osmux.py: using RAC 49 03:53:31.245400 tst mo_mt_call_osmux.py: using CellId 25804 03:53:31.426272 tst mo_mt_call_osmux.py: using BVCI 25805 03:53:31.570352 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:31.583620 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:31.597922 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:31.611533 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:31.626535 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:31.640252 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:53:31.794754 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:53:31.948729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:32.549520 run create_hlr_db(pid=23369): Launched 03:53:32.781427 bus /sierra_2: Setting Powered False 03:53:33.847287 run create_hlr_db(pid=23369): Terminated: ok {rc=0} 03:53:34.322631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23371): Launched 03:53:34.672685 run osmo-hlr_10.42.42.2(pid=23372): Launched 03:53:34.927533 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:35.608616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23374): Launched 03:53:35.955310 run osmo-stp_10.42.42.5(pid=23375): Launched 03:53:36.206330 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:36.892493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23377): Launched 03:53:37.240360 run osmo-msc_10.42.42.6(pid=23378): Launched 03:53:37.605257 run osmo-stp_10.42.42.5(pid=23375): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23375)] 03:53:37.892219 run osmo-stp_10.42.42.5(pid=23375): stdout: | (launched: 2022-12-10_03:53:35.892390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:38.078504 run osmo-stp_10.42.42.5(pid=23375): stderr: | 20221210035336196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035336196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035336196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035336197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035336198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035336198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035336198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:38.218985 run osmo-stp_10.42.42.5(pid=23375): stdout: | (launched: 2022-12-10_03:53:35.892390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:38.353588 run osmo-stp_10.42.42.5(pid=23375): stderr: | 20221210035336196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035336196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035336196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035336197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035336198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035336198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035336198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:38.512372 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23375): Process ended prematurely: osmo-stp_10.42.42.5(pid=23375) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23375)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:53:38.523515 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 03:53:38.554023 run osmo-hlr_10.42.42.2(pid=23372): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23372)] 03:53:38.610214 run osmo-hlr_10.42.42.2(pid=23372): stdout: | (launched: 2022-12-10_03:53:34.606760) 03:53:38.664296 run osmo-hlr_10.42.42.2(pid=23372): stderr: | 20221210035334922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035334922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035334922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035334922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035334922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035334922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035334945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035334961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035334962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035334962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:38.740146 run osmo-msc_10.42.42.6(pid=23378): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23378)] 03:53:38.793192 run osmo-msc_10.42.42.6(pid=23378): stdout: | (launched: 2022-12-10_03:53:37.177564) 03:53:38.846150 run osmo-msc_10.42.42.6(pid=23378): stderr: | 20221210035337688 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035337688 DLGLOBAL DEBUG validating counter group 0x7f56dccabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035337688 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035337688 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035337688 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035337697 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035337700 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035337701 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035337701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035337701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:38.900347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23371): Terminating (SIGTERM) 03:53:38.945301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23374): Terminating (SIGTERM) 03:53:38.998021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23377): Terminating (SIGTERM) 03:53:39.040448 --- ParallelTerminationStrategy: PID 23371 died... 03:53:39.060370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23371): Terminated: ok {rc=0} 03:53:39.106881 --- ParallelTerminationStrategy: PID 23374 died... 03:53:39.126466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23374): Terminated: ok {rc=0} 03:53:39.172736 --- ParallelTerminationStrategy: PID 23377 died... 03:53:39.192116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23377): Terminated: ok {rc=0} 03:53:39.279411 bus /sierra_3: Setting Powered False 03:53:40.376323 bus /sierra_3: Setting Powered False 03:53:41.490237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:53:42.741649 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:42.748621 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:53:42.782590 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:53:42.810322 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:53:42.863613 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:53:42.897717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:53:42.925021 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:53:43.475128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:53:43.526508 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:43.538260 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:53:43.609577 tst mo_mt_call.py: using LAC 25805 03:53:43.730313 tst mo_mt_call.py: using RAC 50 03:53:43.850278 tst mo_mt_call.py: using CellId 25805 03:53:43.971386 tst mo_mt_call.py: using BVCI 25806 03:53:44.081706 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:44.092815 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:44.103806 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:44.114970 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:44.126211 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:44.137348 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:53:44.253700 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:53:44.372398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:44.870272 run create_hlr_db(pid=23383): Launched 03:53:45.000281 bus /sierra_2: Setting Powered False 03:53:46.060881 run create_hlr_db(pid=23383): Terminated: ok {rc=0} 03:53:46.537255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23385): Launched 03:53:46.904548 run osmo-hlr_10.42.42.2(pid=23386): Launched 03:53:47.168303 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:47.851123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23388): Launched 03:53:48.173074 run osmo-stp_10.42.42.5(pid=23389): Launched 03:53:48.294939 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:48.874653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23391): Launched 03:53:49.196189 run osmo-msc_10.42.42.6(pid=23392): Launched 03:53:49.376394 run osmo-stp_10.42.42.5(pid=23389): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23389)] 03:53:49.511618 run osmo-stp_10.42.42.5(pid=23389): stdout: | (launched: 2022-12-10_03:53:48.113702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:49.647768 run osmo-stp_10.42.42.5(pid=23389): stderr: | 20221210035348306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035348306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035348306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035348306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035348309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035348309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035348309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:49.782754 run osmo-stp_10.42.42.5(pid=23389): stdout: | (launched: 2022-12-10_03:53:48.113702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:49.910325 run osmo-stp_10.42.42.5(pid=23389): stderr: | 20221210035348306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035348306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035348306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035348306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035348309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035348309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035348309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:50.063691 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23389): Process ended prematurely: osmo-stp_10.42.42.5(pid=23389) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23389)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:53:50.073335 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 03:53:50.101130 run osmo-hlr_10.42.42.2(pid=23386): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23386)] 03:53:50.151071 run osmo-hlr_10.42.42.2(pid=23386): stdout: | (launched: 2022-12-10_03:53:46.837782) 03:53:50.202763 run osmo-hlr_10.42.42.2(pid=23386): stderr: | 20221210035347223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035347223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035347223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035347223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035347224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035347224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035347246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035347262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035347263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035347263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:50.274571 run osmo-msc_10.42.42.6(pid=23392): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23392)] 03:53:50.324125 run osmo-msc_10.42.42.6(pid=23392): stdout: | (launched: 2022-12-10_03:53:49.137340) 03:53:50.375290 run osmo-msc_10.42.42.6(pid=23392): stderr: | 20221210035349458 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035349458 DLGLOBAL DEBUG validating counter group 0x7f10ec4efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035349458 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035349458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035349459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035349459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035349461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035349461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035349461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035349461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:50.426792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23385): Terminating (SIGTERM) 03:53:50.467865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23388): Terminating (SIGTERM) 03:53:50.509048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23391): Terminating (SIGTERM) 03:53:50.550465 --- ParallelTerminationStrategy: PID 23385 died... 03:53:50.570166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23385): Terminated: ok {rc=0} 03:53:50.615679 --- ParallelTerminationStrategy: PID 23388 died... 03:53:50.634813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23388): Terminated: ok {rc=0} 03:53:50.680464 --- ParallelTerminationStrategy: PID 23391 died... 03:53:50.699776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23391): Terminated: ok {rc=0} 03:53:50.787050 bus /sierra_3: Setting Powered False 03:53:51.886524 bus /sierra_3: Setting Powered False 03:53:53.003393 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:53:54.154053 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:54.166531 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:53:54.238674 tst mo_mt_call_osmux.py: using LAC 25806 03:53:54.366551 tst mo_mt_call_osmux.py: using RAC 51 03:53:54.494272 tst mo_mt_call_osmux.py: using CellId 25806 03:53:54.621416 tst mo_mt_call_osmux.py: using BVCI 25807 03:53:54.738075 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:54.749650 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:54.760869 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:54.772201 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:54.783595 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:53:54.794941 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:53:54.915280 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:53:55.034600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:55.534826 run create_hlr_db(pid=23394): Launched 03:53:55.665037 bus /sierra_2: Setting Powered False 03:53:56.728925 run create_hlr_db(pid=23394): Terminated: ok {rc=0} 03:53:57.160153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23396): Launched 03:53:57.463651 run osmo-hlr_10.42.42.2(pid=23397): Launched 03:53:57.581363 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:58.115939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23399): Launched 03:53:58.418562 run osmo-stp_10.42.42.5(pid=23400): Launched 03:53:58.535061 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:59.082694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23402): Launched 03:53:59.385727 run osmo-msc_10.42.42.6(pid=23403): Launched 03:53:59.555073 run osmo-stp_10.42.42.5(pid=23400): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23400)] 03:53:59.683912 run osmo-stp_10.42.42.5(pid=23400): stdout: | (launched: 2022-12-10_03:53:58.363422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:59.811967 run osmo-stp_10.42.42.5(pid=23400): stderr: | 20221210035358531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035358531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035358531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035358532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035358535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035358535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035358535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:59.938007 run osmo-stp_10.42.42.5(pid=23400): stdout: | (launched: 2022-12-10_03:53:58.363422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:00.058364 run osmo-stp_10.42.42.5(pid=23400): stderr: | 20221210035358531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035358531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035358531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035358532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035358535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035358535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035358535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:00.203042 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23400): Process ended prematurely: osmo-stp_10.42.42.5(pid=23400) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23400)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:54:00.212044 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:54:00.239365 run osmo-hlr_10.42.42.2(pid=23397): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23397)] 03:54:00.287091 run osmo-hlr_10.42.42.2(pid=23397): stdout: | (launched: 2022-12-10_03:53:57.408140) 03:54:00.336676 run osmo-hlr_10.42.42.2(pid=23397): stderr: | 20221210035357586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035357586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035357586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035357587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035357587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035357587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035357599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035357607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035357607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035357607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:00.406248 run osmo-msc_10.42.42.6(pid=23403): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23403)] 03:54:00.454017 run osmo-msc_10.42.42.6(pid=23403): stdout: | (launched: 2022-12-10_03:53:59.329998) 03:54:00.503337 run osmo-msc_10.42.42.6(pid=23403): stderr: | 20221210035359602 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035359602 DLGLOBAL DEBUG validating counter group 0x7fe911f50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035359602 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035359602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035359602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035359602 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035359604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035359605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035359605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035359605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:00.553946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23396): Terminating (SIGTERM) 03:54:00.594100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23399): Terminating (SIGTERM) 03:54:00.634253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23402): Terminating (SIGTERM) 03:54:00.674562 --- ParallelTerminationStrategy: PID 23396 died... 03:54:00.693619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23396): Terminated: ok {rc=0} 03:54:00.738053 --- ParallelTerminationStrategy: PID 23399 died... 03:54:00.756660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23399): Terminated: ok {rc=0} 03:54:00.800869 --- ParallelTerminationStrategy: PID 23402 died... 03:54:00.819992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23402): Terminated: ok {rc=0} 03:54:00.939480 bus /sierra_3: Setting Powered False 03:54:02.045263 bus /sierra_3: Setting Powered False 03:54:03.161846 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:54:04.411575 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:04.420861 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:54:04.455654 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:54:04.483152 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:54:04.536340 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:54:04.569553 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:54:04.596385 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:54:05.145496 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:54:05.195146 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:05.206410 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:54:05.280314 tst mo_mt_call.py: using LAC 25807 03:54:05.407751 tst mo_mt_call.py: using RAC 52 03:54:05.531301 tst mo_mt_call.py: using CellId 25807 03:54:05.656784 tst mo_mt_call.py: using BVCI 25808 03:54:05.773018 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:05.784432 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:05.795684 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:05.806941 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:05.818352 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:05.829673 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:05.946464 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:06.064467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:06.564225 run create_hlr_db(pid=23409): Launched 03:54:06.693969 bus /sierra_2: Setting Powered False 03:54:07.757629 run create_hlr_db(pid=23409): Terminated: ok {rc=0} 03:54:08.188444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23411): Launched 03:54:08.493204 run osmo-hlr_10.42.42.2(pid=23412): Launched 03:54:08.609408 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:09.144537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23414): Launched 03:54:09.447351 run osmo-stp_10.42.42.5(pid=23415): Launched 03:54:09.563422 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:10.113300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23417): Launched 03:54:10.417301 run osmo-msc_10.42.42.6(pid=23418): Launched 03:54:10.587986 run osmo-stp_10.42.42.5(pid=23415): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23415)] 03:54:10.716452 run osmo-stp_10.42.42.5(pid=23415): stdout: | (launched: 2022-12-10_03:54:09.391878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:10.845076 run osmo-stp_10.42.42.5(pid=23415): stderr: | 20221210035409562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035409562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035409562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035409563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035409563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035409563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035409563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:10.971243 run osmo-stp_10.42.42.5(pid=23415): stdout: | (launched: 2022-12-10_03:54:09.391878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:11.091893 run osmo-stp_10.42.42.5(pid=23415): stderr: | 20221210035409562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035409562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035409562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035409563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035409563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035409563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035409563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:11.236178 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23415): Process ended prematurely: osmo-stp_10.42.42.5(pid=23415) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23415)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:54:11.245533 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:54:11.272481 run osmo-hlr_10.42.42.2(pid=23412): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23412)] 03:54:11.320405 run osmo-hlr_10.42.42.2(pid=23412): stdout: | (launched: 2022-12-10_03:54:08.438018) 03:54:11.369907 run osmo-hlr_10.42.42.2(pid=23412): stderr: | 20221210035408613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035408614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035408614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035408614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035408614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035408614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035408626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035408635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035408636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035408636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:11.438404 run osmo-msc_10.42.42.6(pid=23418): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23418)] 03:54:11.485919 run osmo-msc_10.42.42.6(pid=23418): stdout: | (launched: 2022-12-10_03:54:10.361529) 03:54:11.535174 run osmo-msc_10.42.42.6(pid=23418): stderr: | 20221210035410633 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035410633 DLGLOBAL DEBUG validating counter group 0x7f1314a60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035410633 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035410633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035410634 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035410634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035410635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035410636 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035410636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035410636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:11.584775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23411): Terminating (SIGTERM) 03:54:11.624597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23414): Terminating (SIGTERM) 03:54:11.664616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23417): Terminating (SIGTERM) 03:54:11.704683 --- ParallelTerminationStrategy: PID 23411 died... 03:54:11.723544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23411): Terminated: ok {rc=0} 03:54:11.767700 --- ParallelTerminationStrategy: PID 23414 died... 03:54:11.785951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23414): Terminated: ok {rc=0} 03:54:11.829950 --- ParallelTerminationStrategy: PID 23417 died... 03:54:11.848380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23417): Terminated: ok {rc=0} 03:54:11.935184 bus /sierra_3: Setting Powered False 03:54:13.033342 bus /sierra_3: Setting Powered False 03:54:14.147925 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:54:15.294621 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:15.306368 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:54:15.376467 tst mo_mt_call_osmux.py: using LAC 25808 03:54:15.494218 tst mo_mt_call_osmux.py: using RAC 53 03:54:15.614201 tst mo_mt_call_osmux.py: using CellId 25808 03:54:15.734943 tst mo_mt_call_osmux.py: using BVCI 25809 03:54:15.850618 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:15.862564 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:15.876412 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:15.889125 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:15.902809 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:15.921769 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:16.055152 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:16.173205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:16.689617 run create_hlr_db(pid=23420): Launched 03:54:16.856186 bus /sierra_2: Setting Powered False 03:54:17.920573 run create_hlr_db(pid=23420): Terminated: ok {rc=0} 03:54:18.352339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23422): Launched 03:54:18.655578 run osmo-hlr_10.42.42.2(pid=23423): Launched 03:54:18.772587 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:19.291683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23425): Launched 03:54:19.593923 run osmo-stp_10.42.42.5(pid=23426): Launched 03:54:19.708503 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:20.254296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23428): Launched 03:54:20.556817 run osmo-msc_10.42.42.6(pid=23429): Launched 03:54:20.726208 run osmo-stp_10.42.42.5(pid=23426): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23426)] 03:54:20.854841 run osmo-stp_10.42.42.5(pid=23426): stdout: | (launched: 2022-12-10_03:54:19.538563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:20.983439 run osmo-stp_10.42.42.5(pid=23426): stderr: | 20221210035419709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035419709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035419709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035419709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035419710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035419710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035419710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:21.109706 run osmo-stp_10.42.42.5(pid=23426): stdout: | (launched: 2022-12-10_03:54:19.538563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:21.230569 run osmo-stp_10.42.42.5(pid=23426): stderr: | 20221210035419709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035419709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035419709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035419709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035419710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035419710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035419710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:21.375171 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23426): Process ended prematurely: osmo-stp_10.42.42.5(pid=23426) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23426)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:54:21.384321 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:54:21.411547 run osmo-hlr_10.42.42.2(pid=23423): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23423)] 03:54:21.459586 run osmo-hlr_10.42.42.2(pid=23423): stdout: | (launched: 2022-12-10_03:54:18.600093) 03:54:21.509309 run osmo-hlr_10.42.42.2(pid=23423): stderr: | 20221210035418776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035418776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035418776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035418776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035418776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035418776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035418788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035418796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035418797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035418797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:21.578862 run osmo-msc_10.42.42.6(pid=23429): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23429)] 03:54:21.626995 run osmo-msc_10.42.42.6(pid=23429): stdout: | (launched: 2022-12-10_03:54:20.501427) 03:54:21.676605 run osmo-msc_10.42.42.6(pid=23429): stderr: | 20221210035420774 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035420774 DLGLOBAL DEBUG validating counter group 0x7fba5cdf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035420774 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035420774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035420775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035420775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035420777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035420778 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035420778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035420778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:21.726580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23422): Terminating (SIGTERM) 03:54:21.766661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23425): Terminating (SIGTERM) 03:54:21.807057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23428): Terminating (SIGTERM) 03:54:21.847616 --- ParallelTerminationStrategy: PID 23422 died... 03:54:21.866767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23422): Terminated: ok {rc=0} 03:54:21.911604 --- ParallelTerminationStrategy: PID 23425 died... 03:54:21.930326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23425): Terminated: ok {rc=0} 03:54:21.974704 --- ParallelTerminationStrategy: PID 23428 died... 03:54:21.993373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23428): Terminated: ok {rc=0} 03:54:22.078797 bus /sierra_3: Setting Powered False 03:54:23.179341 bus /sierra_3: Setting Powered False 03:54:24.295737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:54:25.544136 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:25.552043 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:54:25.587027 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:54:25.613820 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:54:25.666977 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:54:25.701352 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:54:25.728546 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:54:26.274994 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:54:26.324465 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:26.335700 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:54:26.404365 tst mo_mt_call.py: using LAC 25809 03:54:26.522877 tst mo_mt_call.py: using RAC 54 03:54:26.642869 tst mo_mt_call.py: using CellId 25809 03:54:26.762931 tst mo_mt_call.py: using BVCI 25810 03:54:26.872306 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:26.883396 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:26.894354 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:26.905798 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:26.917951 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:26.929202 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:54:27.050254 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:54:27.169648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:27.668899 run create_hlr_db(pid=23435): Launched 03:54:27.800717 bus /sierra_2: Setting Powered False 03:54:28.864502 run create_hlr_db(pid=23435): Terminated: ok {rc=0} 03:54:29.295033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23438): Launched 03:54:29.598277 run osmo-hlr_10.42.42.2(pid=23439): Launched 03:54:29.714554 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:30.247959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23441): Launched 03:54:30.550571 run osmo-stp_10.42.42.5(pid=23442): Launched 03:54:30.666568 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:31.269942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23444): Launched 03:54:31.604550 run osmo-msc_10.42.42.6(pid=23445): Launched 03:54:31.804325 run osmo-stp_10.42.42.5(pid=23442): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23442)] 03:54:32.071821 run osmo-stp_10.42.42.5(pid=23442): stdout: | (launched: 2022-12-10_03:54:30.495404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:32.379242 run osmo-stp_10.42.42.5(pid=23442): stderr: | 20221210035430666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035430666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035430666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035430667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035430667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035430667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035430667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:32.517387 run osmo-stp_10.42.42.5(pid=23442): stdout: | (launched: 2022-12-10_03:54:30.495404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:32.650245 run osmo-stp_10.42.42.5(pid=23442): stderr: | 20221210035430666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035430666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035430666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035430667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035430667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035430667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035430667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:32.805249 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23442): Process ended prematurely: osmo-stp_10.42.42.5(pid=23442) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23442)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:54:32.815136 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 03:54:32.843510 run osmo-hlr_10.42.42.2(pid=23439): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23439)] 03:54:32.894474 run osmo-hlr_10.42.42.2(pid=23439): stdout: | (launched: 2022-12-10_03:54:29.542649) 03:54:32.946660 run osmo-hlr_10.42.42.2(pid=23439): stderr: | 20221210035429718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035429718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035429718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035429718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035429718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035429718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035429731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035429742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035429742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035429742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:33.019391 run osmo-msc_10.42.42.6(pid=23445): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23445)] 03:54:33.069946 run osmo-msc_10.42.42.6(pid=23445): stdout: | (launched: 2022-12-10_03:54:31.544144) 03:54:33.122068 run osmo-msc_10.42.42.6(pid=23445): stderr: | 20221210035432276 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035432276 DLGLOBAL DEBUG validating counter group 0x7f436b08fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035432276 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035432276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035432277 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035432277 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035432280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035432285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035432285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035432285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:33.174512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23438): Terminating (SIGTERM) 03:54:33.216779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23441): Terminating (SIGTERM) 03:54:33.259296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23444): Terminating (SIGTERM) 03:54:33.301652 --- ParallelTerminationStrategy: PID 23438 died... 03:54:33.321767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23438): Terminated: ok {rc=0} 03:54:33.368835 --- ParallelTerminationStrategy: PID 23441 died... 03:54:33.388582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23441): Terminated: ok {rc=0} 03:54:33.435719 --- ParallelTerminationStrategy: PID 23444 died... 03:54:33.455133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23444): Terminated: ok {rc=0} 03:54:33.543847 bus /sierra_3: Setting Powered False 03:54:34.642577 bus /sierra_3: Setting Powered False 03:54:35.760117 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:54:36.909608 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:36.921663 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:54:36.992760 tst mo_mt_call_osmux.py: using LAC 25810 03:54:37.120857 tst mo_mt_call_osmux.py: using RAC 55 03:54:37.249173 tst mo_mt_call_osmux.py: using CellId 25810 03:54:37.374924 tst mo_mt_call_osmux.py: using BVCI 25811 03:54:37.491417 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:37.503164 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:37.514561 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:37.525953 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:37.537576 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:37.548997 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:54:37.667481 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:54:37.785177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:38.255151 run create_hlr_db(pid=23447): Launched 03:54:38.370856 bus /sierra_2: Setting Powered False 03:54:39.431468 run create_hlr_db(pid=23447): Terminated: ok {rc=0} 03:54:39.852928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23449): Launched 03:54:40.156814 run osmo-hlr_10.42.42.2(pid=23450): Launched 03:54:40.273109 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:40.805028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23452): Launched 03:54:41.107809 run osmo-stp_10.42.42.5(pid=23453): Launched 03:54:41.223801 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:41.771370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23455): Launched 03:54:42.074577 run osmo-msc_10.42.42.6(pid=23456): Launched 03:54:42.243879 run osmo-stp_10.42.42.5(pid=23453): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23453)] 03:54:42.372160 run osmo-stp_10.42.42.5(pid=23453): stdout: | (launched: 2022-12-10_03:54:41.052350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:42.500484 run osmo-stp_10.42.42.5(pid=23453): stderr: | 20221210035441225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035441225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035441225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035441226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035441226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035441226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035441226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:42.627455 run osmo-stp_10.42.42.5(pid=23453): stdout: | (launched: 2022-12-10_03:54:41.052350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:42.747845 run osmo-stp_10.42.42.5(pid=23453): stderr: | 20221210035441225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035441225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035441225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035441226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035441226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035441226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035441226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:42.892054 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23453): Process ended prematurely: osmo-stp_10.42.42.5(pid=23453) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23453)] [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:54:42.901253 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:54:42.928370 run osmo-hlr_10.42.42.2(pid=23450): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23450)] 03:54:42.976181 run osmo-hlr_10.42.42.2(pid=23450): stdout: | (launched: 2022-12-10_03:54:40.100865) 03:54:43.025781 run osmo-hlr_10.42.42.2(pid=23450): stderr: | 20221210035440277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035440277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035440277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035440277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035440277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035440277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035440288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035440298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035440299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035440299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:43.094554 run osmo-msc_10.42.42.6(pid=23456): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23456)] 03:54:43.142292 run osmo-msc_10.42.42.6(pid=23456): stdout: | (launched: 2022-12-10_03:54:42.019099) 03:54:43.191652 run osmo-msc_10.42.42.6(pid=23456): stderr: | 20221210035442292 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035442292 DLGLOBAL DEBUG validating counter group 0x7fa257a2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035442292 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035442292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035442292 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035442292 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035442294 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035442295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035442295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035442295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:43.241378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23449): Terminating (SIGTERM) 03:54:43.281116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23452): Terminating (SIGTERM) 03:54:43.321172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23455): Terminating (SIGTERM) 03:54:43.361437 --- ParallelTerminationStrategy: PID 23449 died... 03:54:43.380543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23449): Terminated: ok {rc=0} 03:54:43.425153 --- ParallelTerminationStrategy: PID 23452 died... 03:54:43.443715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23452): Terminated: ok {rc=0} 03:54:43.488064 --- ParallelTerminationStrategy: PID 23455 died... 03:54:43.506751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23455): Terminated: ok {rc=0} 03:54:43.592462 bus /sierra_3: Setting Powered False 03:54:44.691519 bus /sierra_3: Setting Powered False 03:54:45.807496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:54:47.075157 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:47.084817 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:54:47.132603 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:54:47.164494 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:54:47.215608 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:54:47.250937 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:54:47.278682 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:54:47.836713 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:54:47.888337 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:47.900177 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:54:47.974868 tst mo_mt_call.py: using LAC 25811 03:54:48.101143 tst mo_mt_call.py: using RAC 56 03:54:48.226197 tst mo_mt_call.py: using CellId 25811 03:54:48.353592 tst mo_mt_call.py: using BVCI 25812 03:54:48.471900 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:48.483615 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:48.495122 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:48.506636 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:48.518149 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:48.529655 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:54:48.644478 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:54:48.763194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:49.262760 run create_hlr_db(pid=23461): Launched 03:54:49.389397 bus /sierra_2: Setting Powered False 03:54:50.453236 run create_hlr_db(pid=23461): Terminated: ok {rc=0} 03:54:50.884582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23463): Launched 03:54:51.187268 run osmo-hlr_10.42.42.2(pid=23464): Launched 03:54:51.302054 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:51.835438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23466): Launched 03:54:52.137235 run osmo-stp_10.42.42.5(pid=23467): Launched 03:54:52.252281 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:52.799691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23469): Launched 03:54:53.102539 run osmo-msc_10.42.42.6(pid=23470): Launched 03:54:53.272026 run osmo-stp_10.42.42.5(pid=23467): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23467)] 03:54:53.400934 run osmo-stp_10.42.42.5(pid=23467): stdout: | (launched: 2022-12-10_03:54:52.081995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:53.529336 run osmo-stp_10.42.42.5(pid=23467): stderr: | 20221210035452252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035452252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035452252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035452253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035452253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035452253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035452253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:53.655106 run osmo-stp_10.42.42.5(pid=23467): stdout: | (launched: 2022-12-10_03:54:52.081995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:53.777731 run osmo-stp_10.42.42.5(pid=23467): stderr: | 20221210035452252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035452252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035452252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035452253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035452253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035452253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035452253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:53.922272 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23467): Process ended prematurely: osmo-stp_10.42.42.5(pid=23467) [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23467)] [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:54:53.931121 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:54:53.958067 run osmo-hlr_10.42.42.2(pid=23464): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23464)] 03:54:54.005749 run osmo-hlr_10.42.42.2(pid=23464): stdout: | (launched: 2022-12-10_03:54:51.131794) 03:54:54.054992 run osmo-hlr_10.42.42.2(pid=23464): stderr: | 20221210035451308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035451308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035451308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035451309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035451309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035451309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035451320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035451328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035451328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035451328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:54.124053 run osmo-msc_10.42.42.6(pid=23470): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23470)] 03:54:54.171669 run osmo-msc_10.42.42.6(pid=23470): stdout: | (launched: 2022-12-10_03:54:53.046989) 03:54:54.220738 run osmo-msc_10.42.42.6(pid=23470): stderr: | 20221210035453318 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035453318 DLGLOBAL DEBUG validating counter group 0x7f9439432c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035453318 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035453318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035453319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035453319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035453321 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035453322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035453322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035453322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:54.270298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23463): Terminating (SIGTERM) 03:54:54.310212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23466): Terminating (SIGTERM) 03:54:54.350618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23469): Terminating (SIGTERM) 03:54:54.390594 --- ParallelTerminationStrategy: PID 23463 died... 03:54:54.409519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23463): Terminated: ok {rc=0} 03:54:54.453973 --- ParallelTerminationStrategy: PID 23466 died... 03:54:54.472326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23466): Terminated: ok {rc=0} 03:54:54.516255 --- ParallelTerminationStrategy: PID 23469 died... 03:54:54.534749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23469): Terminated: ok {rc=0} 03:54:54.620090 bus /sierra_3: Setting Powered False 03:54:55.718860 bus /sierra_3: Setting Powered False 03:54:56.834024 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:54:57.980661 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:57.993228 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:54:58.065176 tst mo_mt_call_osmux.py: using LAC 25812 03:54:58.191282 tst mo_mt_call_osmux.py: using RAC 57 03:54:58.317581 tst mo_mt_call_osmux.py: using CellId 25812 03:54:58.443843 tst mo_mt_call_osmux.py: using BVCI 25813 03:54:58.560564 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:58.572401 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:58.584325 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:58.595930 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:58.607569 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:54:58.619203 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:54:58.735422 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:54:58.853585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:59.322784 run create_hlr_db(pid=23472): Launched 03:54:59.439799 bus /sierra_2: Setting Powered False 03:55:00.499838 run create_hlr_db(pid=23472): Terminated: ok {rc=0} 03:55:00.926726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23474): Launched 03:55:01.279727 run osmo-hlr_10.42.42.2(pid=23475): Launched 03:55:01.424830 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:02.162492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23480): Launched 03:55:02.496482 run osmo-stp_10.42.42.5(pid=23481): Launched 03:55:02.621243 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:03.205210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23483): Launched 03:55:03.527245 run osmo-msc_10.42.42.6(pid=23484): Launched 03:55:03.707193 run osmo-stp_10.42.42.5(pid=23481): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23481)] 03:55:03.842735 run osmo-stp_10.42.42.5(pid=23481): stdout: | (launched: 2022-12-10_03:55:02.437719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:03.978574 run osmo-stp_10.42.42.5(pid=23481): stderr: | 20221210035502629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035502630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035502630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035502630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035502631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035502631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035502631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:04.114035 run osmo-stp_10.42.42.5(pid=23481): stdout: | (launched: 2022-12-10_03:55:02.437719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:04.243103 run osmo-stp_10.42.42.5(pid=23481): stderr: | 20221210035502629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035502630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035502630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035502630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035502631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035502631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035502631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:04.397249 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23481): Process ended prematurely: osmo-stp_10.42.42.5(pid=23481) [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23481)] [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:55:04.407093 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:55:04.434824 run osmo-hlr_10.42.42.2(pid=23475): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23475)] 03:55:04.484841 run osmo-hlr_10.42.42.2(pid=23475): stdout: | (launched: 2022-12-10_03:55:01.218725) 03:55:04.536732 run osmo-hlr_10.42.42.2(pid=23475): stderr: | 20221210035501597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035501597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035501597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035501597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035501598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035501598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035501609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035501625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035501626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035501626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:04.608800 run osmo-msc_10.42.42.6(pid=23484): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23484)] 03:55:04.658409 run osmo-msc_10.42.42.6(pid=23484): stdout: | (launched: 2022-12-10_03:55:03.468411) 03:55:04.709909 run osmo-msc_10.42.42.6(pid=23484): stderr: | 20221210035503792 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035503792 DLGLOBAL DEBUG validating counter group 0x7f1160ba9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035503792 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035503792 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035503792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035503793 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035503794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035503795 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035503795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035503795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:04.762039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23474): Terminating (SIGTERM) 03:55:04.803296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23480): Terminating (SIGTERM) 03:55:04.844876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23483): Terminating (SIGTERM) 03:55:04.886623 --- ParallelTerminationStrategy: PID 23474 died... 03:55:04.906459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23474): Terminated: ok {rc=0} 03:55:04.952761 --- ParallelTerminationStrategy: PID 23480 died... 03:55:04.972417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23480): Terminated: ok {rc=0} 03:55:05.018330 --- ParallelTerminationStrategy: PID 23483 died... 03:55:05.037731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23483): Terminated: ok {rc=0} 03:55:05.125483 bus /sierra_3: Setting Powered False 03:55:06.224863 bus /sierra_3: Setting Powered False 03:55:07.342518 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:55:08.589780 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:08.595374 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:55:08.628690 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:55:08.655277 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:55:08.706301 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:55:08.739195 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:55:08.766091 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:55:09.323136 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:55:09.375506 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:09.387010 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:55:09.457569 tst mo_mt_call.py: using LAC 25813 03:55:09.576816 tst mo_mt_call.py: using RAC 58 03:55:09.693359 tst mo_mt_call.py: using CellId 25813 03:55:09.810189 tst mo_mt_call.py: using BVCI 25814 03:55:09.918930 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:09.929869 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:09.940571 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:09.951904 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:09.962831 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:09.973879 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:10.092477 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:10.209233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:10.679538 run create_hlr_db(pid=23490): Launched 03:55:10.795315 bus /sierra_2: Setting Powered False 03:55:11.855610 run create_hlr_db(pid=23490): Terminated: ok {rc=0} 03:55:12.278324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23492): Launched 03:55:12.581689 run osmo-hlr_10.42.42.2(pid=23493): Launched 03:55:12.697449 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:13.220796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23495): Launched 03:55:13.523474 run osmo-stp_10.42.42.5(pid=23496): Launched 03:55:13.639502 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:14.186875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23498): Launched 03:55:14.490287 run osmo-msc_10.42.42.6(pid=23499): Launched 03:55:14.659674 run osmo-stp_10.42.42.5(pid=23496): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23496)] 03:55:14.787842 run osmo-stp_10.42.42.5(pid=23496): stdout: | (launched: 2022-12-10_03:55:13.467867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:14.916881 run osmo-stp_10.42.42.5(pid=23496): stderr: | 20221210035513639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035513639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035513639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035513640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035513640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035513640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035513640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:15.043055 run osmo-stp_10.42.42.5(pid=23496): stdout: | (launched: 2022-12-10_03:55:13.467867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:15.163691 run osmo-stp_10.42.42.5(pid=23496): stderr: | 20221210035513639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035513639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035513639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035513640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035513640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035513640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035513640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:15.307686 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23496): Process ended prematurely: osmo-stp_10.42.42.5(pid=23496) [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23496)] [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:55:15.316641 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:55:15.344000 run osmo-hlr_10.42.42.2(pid=23493): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23493)] 03:55:15.391599 run osmo-hlr_10.42.42.2(pid=23493): stdout: | (launched: 2022-12-10_03:55:12.525653) 03:55:15.440788 run osmo-hlr_10.42.42.2(pid=23493): stderr: | 20221210035512701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035512701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035512701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035512701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035512701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035512701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035512713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035512721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035512722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035512722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:15.509381 run osmo-msc_10.42.42.6(pid=23499): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23499)] 03:55:15.556870 run osmo-msc_10.42.42.6(pid=23499): stdout: | (launched: 2022-12-10_03:55:14.434740) 03:55:15.606069 run osmo-msc_10.42.42.6(pid=23499): stderr: | 20221210035514707 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035514707 DLGLOBAL DEBUG validating counter group 0x7ff13d796c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035514707 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035514707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035514707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035514707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035514710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035514710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035514710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035514710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:15.655663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23492): Terminating (SIGTERM) 03:55:15.695114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23495): Terminating (SIGTERM) 03:55:15.734633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23498): Terminating (SIGTERM) 03:55:15.774294 --- ParallelTerminationStrategy: PID 23492 died... 03:55:15.793151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23492): Terminated: ok {rc=0} 03:55:15.845522 --- ParallelTerminationStrategy: PID 23495 died... 03:55:15.872099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23495): Terminated: ok {rc=0} 03:55:15.920905 --- ParallelTerminationStrategy: PID 23498 died... 03:55:15.940027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23498): Terminated: ok {rc=0} 03:55:16.026007 bus /sierra_3: Setting Powered False 03:55:17.126475 bus /sierra_3: Setting Powered False 03:55:18.240997 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:55:19.389329 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:19.401526 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:55:19.473648 tst mo_mt_call_osmux.py: using LAC 25814 03:55:19.599588 tst mo_mt_call_osmux.py: using RAC 59 03:55:19.725500 tst mo_mt_call_osmux.py: using CellId 25814 03:55:19.855526 tst mo_mt_call_osmux.py: using BVCI 25815 03:55:19.973684 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:19.985206 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:19.996460 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:20.007742 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:20.019009 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:20.030318 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:20.147607 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:20.268729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:20.770629 run create_hlr_db(pid=23501): Launched 03:55:20.902105 bus /sierra_2: Setting Powered False 03:55:21.962991 run create_hlr_db(pid=23501): Terminated: ok {rc=0} 03:55:22.395538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23503): Launched 03:55:22.699703 run osmo-hlr_10.42.42.2(pid=23504): Launched 03:55:22.814945 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:23.348124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23506): Launched 03:55:23.651771 run osmo-stp_10.42.42.5(pid=23507): Launched 03:55:23.767651 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:24.316473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23509): Launched 03:55:24.621563 run osmo-msc_10.42.42.6(pid=23510): Launched 03:55:24.791924 run osmo-stp_10.42.42.5(pid=23507): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23507)] 03:55:24.921291 run osmo-stp_10.42.42.5(pid=23507): stdout: | (launched: 2022-12-10_03:55:23.596378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:25.049900 run osmo-stp_10.42.42.5(pid=23507): stderr: | 20221210035523766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035523767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035523767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035523767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035523768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035523768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035523768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:25.176394 run osmo-stp_10.42.42.5(pid=23507): stdout: | (launched: 2022-12-10_03:55:23.596378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:25.297076 run osmo-stp_10.42.42.5(pid=23507): stderr: | 20221210035523766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035523767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035523767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035523767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035523768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035523768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035523768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:25.441901 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23507): Process ended prematurely: osmo-stp_10.42.42.5(pid=23507) [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23507)] [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:55:25.450738 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:55:25.477770 run osmo-hlr_10.42.42.2(pid=23504): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23504)] 03:55:25.526058 run osmo-hlr_10.42.42.2(pid=23504): stdout: | (launched: 2022-12-10_03:55:22.643567) 03:55:25.575612 run osmo-hlr_10.42.42.2(pid=23504): stderr: | 20221210035522821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035522821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035522821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035522821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035522821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035522822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035522834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035522843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035522843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035522843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:25.644479 run osmo-msc_10.42.42.6(pid=23510): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23510)] 03:55:25.692270 run osmo-msc_10.42.42.6(pid=23510): stdout: | (launched: 2022-12-10_03:55:24.565900) 03:55:25.741741 run osmo-msc_10.42.42.6(pid=23510): stderr: | 20221210035524839 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035524839 DLGLOBAL DEBUG validating counter group 0x7f7d3c362c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035524839 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035524839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035524839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035524839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035524842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035524842 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035524842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035524842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:25.791672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23503): Terminating (SIGTERM) 03:55:25.831504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23506): Terminating (SIGTERM) 03:55:25.871314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23509): Terminating (SIGTERM) 03:55:25.911542 --- ParallelTerminationStrategy: PID 23503 died... 03:55:25.930574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23503): Terminated: ok {rc=0} 03:55:25.975574 --- ParallelTerminationStrategy: PID 23506 died... 03:55:25.994180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23506): Terminated: ok {rc=0} 03:55:26.038407 --- ParallelTerminationStrategy: PID 23509 died... 03:55:26.056759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23509): Terminated: ok {rc=0} 03:55:26.141404 bus /sierra_3: Setting Powered False 03:55:27.238926 bus /sierra_3: Setting Powered False 03:55:28.356074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 03:55:29.604277 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:29.609159 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 03:55:29.642297 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 03:55:29.668522 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 03:55:29.719486 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 03:55:29.752169 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 03:55:29.778539 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 03:55:30.327340 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 03:55:30.376075 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:30.386958 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 03:55:30.437262 tst mo_mt_call.py: using LAC 25815 03:55:30.557129 tst mo_mt_call.py: using RAC 60 03:55:30.675719 tst mo_mt_call.py: using CellId 25815 03:55:30.794605 tst mo_mt_call.py: using BVCI 25816 03:55:30.913924 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:30.926053 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:30.937803 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:30.949833 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:30.962373 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:30.975506 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:55:31.097855 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:55:31.253408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:31.799205 run create_hlr_db(pid=23516): Launched 03:55:31.966930 bus /sierra_2: Setting Powered False 03:55:33.030709 run create_hlr_db(pid=23516): Terminated: ok {rc=0} 03:55:33.479448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23518): Launched 03:55:33.801490 run osmo-hlr_10.42.42.2(pid=23519): Launched 03:55:33.924160 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:34.478990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23521): Launched 03:55:34.801332 run osmo-stp_10.42.42.5(pid=23522): Launched 03:55:34.923820 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:35.505642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23524): Launched 03:55:35.827446 run osmo-msc_10.42.42.6(pid=23525): Launched 03:55:36.006328 run osmo-stp_10.42.42.5(pid=23522): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23522)] 03:55:36.146106 run osmo-stp_10.42.42.5(pid=23522): stdout: | (launched: 2022-12-10_03:55:34.742680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:36.281165 run osmo-stp_10.42.42.5(pid=23522): stderr: | 20221210035534933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035534933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035534933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035534933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035534936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035534936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035534936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:36.414780 run osmo-stp_10.42.42.5(pid=23522): stdout: | (launched: 2022-12-10_03:55:34.742680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:36.542808 run osmo-stp_10.42.42.5(pid=23522): stderr: | 20221210035534933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035534933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035534933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035534933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035534936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035534936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035534936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:36.695865 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23522): Process ended prematurely: osmo-stp_10.42.42.5(pid=23522) [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23522)] [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 03:55:36.705690 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:55:36.733299 run osmo-hlr_10.42.42.2(pid=23519): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23519)] 03:55:36.783044 run osmo-hlr_10.42.42.2(pid=23519): stdout: | (launched: 2022-12-10_03:55:33.743029) 03:55:36.834325 run osmo-hlr_10.42.42.2(pid=23519): stderr: | 20221210035533943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035533943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035533943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035533943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035533943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035533943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035533955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035533965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035533965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035533965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:36.905649 run osmo-msc_10.42.42.6(pid=23525): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23525)] 03:55:36.954965 run osmo-msc_10.42.42.6(pid=23525): stdout: | (launched: 2022-12-10_03:55:35.768789) 03:55:37.006841 run osmo-msc_10.42.42.6(pid=23525): stderr: | 20221210035536092 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035536093 DLGLOBAL DEBUG validating counter group 0x7fd76e2ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035536093 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035536093 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035536093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035536093 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035536095 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035536095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035536096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035536096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:37.058706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23518): Terminating (SIGTERM) 03:55:37.100097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23521): Terminating (SIGTERM) 03:55:37.141517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23524): Terminating (SIGTERM) 03:55:37.182739 --- ParallelTerminationStrategy: PID 23518 died... 03:55:37.202406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23518): Terminated: ok {rc=0} 03:55:37.248124 --- ParallelTerminationStrategy: PID 23521 died... 03:55:37.267617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23521): Terminated: ok {rc=0} 03:55:37.313227 --- ParallelTerminationStrategy: PID 23524 died... 03:55:37.332491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23524): Terminated: ok {rc=0} 03:55:37.419113 bus /sierra_3: Setting Powered False 03:55:38.517563 bus /sierra_3: Setting Powered False 03:55:39.632871 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 03:55:40.780395 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:40.791777 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 03:55:40.841987 tst mo_mt_call_osmux.py: using LAC 25816 03:55:40.961566 tst mo_mt_call_osmux.py: using RAC 61 03:55:41.088929 tst mo_mt_call_osmux.py: using CellId 25816 03:55:41.218957 tst mo_mt_call_osmux.py: using BVCI 25817 03:55:41.337595 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:41.349236 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:41.360506 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:41.371721 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:41.382961 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:55:41.394228 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:55:41.511631 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:55:41.627974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:42.100038 run create_hlr_db(pid=23527): Launched 03:55:42.216535 bus /sierra_2: Setting Powered False 03:55:43.277716 run create_hlr_db(pid=23527): Terminated: ok {rc=0} 03:55:43.718631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23529): Launched 03:55:44.042397 run osmo-hlr_10.42.42.2(pid=23530): Launched 03:55:44.165283 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:44.720317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23532): Launched 03:55:45.042681 run osmo-stp_10.42.42.5(pid=23533): Launched 03:55:45.165946 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:45.749427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23535): Launched 03:55:46.089739 run osmo-msc_10.42.42.6(pid=23536): Launched 03:55:46.458326 run osmo-stp_10.42.42.5(pid=23533): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23533)] 03:55:46.827828 run osmo-stp_10.42.42.5(pid=23533): stdout: | (launched: 2022-12-10_03:55:44.983933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:46.966191 run osmo-stp_10.42.42.5(pid=23533): stderr: | 20221210035545177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035545177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035545177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035545178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035545180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035545180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035545180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:47.103672 run osmo-stp_10.42.42.5(pid=23533): stdout: | (launched: 2022-12-10_03:55:44.983933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:47.235046 run osmo-stp_10.42.42.5(pid=23533): stderr: | 20221210035545177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035545177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035545177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035545178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035545180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035545180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035545180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:47.392087 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23533): Process ended prematurely: osmo-stp_10.42.42.5(pid=23533) [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23533)] [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 03:55:47.402406 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 03:55:47.431020 run osmo-hlr_10.42.42.2(pid=23530): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23530)] 03:55:47.481198 run osmo-hlr_10.42.42.2(pid=23530): stdout: | (launched: 2022-12-10_03:55:43.983393) 03:55:47.532847 run osmo-hlr_10.42.42.2(pid=23530): stderr: | 20221210035544184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035544184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035544184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035544184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035544184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035544184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035544197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035544205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035544205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035544205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:47.604566 run osmo-msc_10.42.42.6(pid=23536): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23536)] 03:55:47.654333 run osmo-msc_10.42.42.6(pid=23536): stdout: | (launched: 2022-12-10_03:55:46.023309) 03:55:47.705612 run osmo-msc_10.42.42.6(pid=23536): stderr: | 20221210035546525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035546525 DLGLOBAL DEBUG validating counter group 0x7f7d44e3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035546525 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035546525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035546526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035546526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035546529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035546530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035546530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035546530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:47.757352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23529): Terminating (SIGTERM) 03:55:47.799201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23532): Terminating (SIGTERM) 03:55:47.840905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23535): Terminating (SIGTERM) 03:55:47.882869 --- ParallelTerminationStrategy: PID 23529 died... 03:55:47.902863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23529): Terminated: ok {rc=0} 03:55:47.949073 --- ParallelTerminationStrategy: PID 23532 died... 03:55:47.968527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23532): Terminated: ok {rc=0} 03:55:48.014459 --- ParallelTerminationStrategy: PID 23535 died... 03:55:48.034110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23535): Terminated: ok {rc=0} 03:55:48.121983 bus /sierra_3: Setting Powered False 03:55:49.221065 bus /sierra_3: Setting Powered False 03:55:50.336678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:55:51.585356 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:51.591922 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:55:51.626100 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 03:55:51.653954 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 03:55:51.707206 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:55:51.741117 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 03:55:51.768448 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 03:55:52.322300 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 03:55:52.375503 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:55:52.387461 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:55:52.441691 tst mo_mt_call.py: using LAC 25817 03:55:52.574671 tst mo_mt_call.py: using RAC 62 03:55:52.701177 tst mo_mt_call.py: using CellId 25817 03:55:52.825387 tst mo_mt_call.py: using BVCI 25818 03:55:52.942318 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:55:52.954162 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:55:52.965798 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:55:52.977496 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:55:52.989263 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:55:53.000834 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:55:53.115902 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:55:53.231156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:53.701531 run create_hlr_db(pid=23541): Launched 03:55:53.818553 bus /sierra_2: Setting Powered False 03:55:54.878349 run create_hlr_db(pid=23541): Terminated: ok {rc=0} 03:55:55.320731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23543): Launched 03:55:55.642767 run osmo-hlr_10.42.42.2(pid=23544): Launched 03:55:55.766075 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:56.320005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23546): Launched 03:55:56.643780 run osmo-stp_10.42.42.5(pid=23547): Launched 03:55:56.767034 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:57.354415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23549): Launched 03:55:57.677457 run osmo-msc_10.42.42.6(pid=23550): Launched 03:55:57.857251 run osmo-stp_10.42.42.5(pid=23547): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23547)] 03:55:57.992818 run osmo-stp_10.42.42.5(pid=23547): stdout: | (launched: 2022-12-10_03:55:56.584706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:58.129226 run osmo-stp_10.42.42.5(pid=23547): stderr: | 20221210035556780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035556780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035556780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035556780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035556781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035556781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035556781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:58.265073 run osmo-stp_10.42.42.5(pid=23547): stdout: | (launched: 2022-12-10_03:55:56.584706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:58.393257 run osmo-stp_10.42.42.5(pid=23547): stderr: | 20221210035556780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035556780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035556780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035556780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035556781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035556781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035556781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:58.546722 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23547): Process ended prematurely: osmo-stp_10.42.42.5(pid=23547) [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23547)] [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 03:55:58.556308 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:55:58.583995 run osmo-hlr_10.42.42.2(pid=23544): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23544)] 03:55:58.633240 run osmo-hlr_10.42.42.2(pid=23544): stdout: | (launched: 2022-12-10_03:55:55.584292) 03:55:58.684254 run osmo-hlr_10.42.42.2(pid=23544): stderr: | 20221210035555785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035555785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035555785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035555785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035555785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035555785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035555797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035555805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035555805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035555805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:58.755329 run osmo-msc_10.42.42.6(pid=23550): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23550)] 03:55:58.804938 run osmo-msc_10.42.42.6(pid=23550): stdout: | (launched: 2022-12-10_03:55:57.618583) 03:55:58.855962 run osmo-msc_10.42.42.6(pid=23550): stderr: | 20221210035557943 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035557943 DLGLOBAL DEBUG validating counter group 0x7f79a1261c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035557943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035557943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035557943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035557944 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035557945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035557946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035557946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035557946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:58.907391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23543): Terminating (SIGTERM) 03:55:58.948713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23546): Terminating (SIGTERM) 03:55:58.989866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23549): Terminating (SIGTERM) 03:55:59.031337 --- ParallelTerminationStrategy: PID 23543 died... 03:55:59.050876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23543): Terminated: ok {rc=0} 03:55:59.096798 --- ParallelTerminationStrategy: PID 23546 died... 03:55:59.116206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23546): Terminated: ok {rc=0} 03:55:59.162197 --- ParallelTerminationStrategy: PID 23549 died... 03:55:59.181756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23549): Terminated: ok {rc=0} 03:55:59.269433 bus /sierra_3: Setting Powered False 03:56:00.366031 bus /sierra_3: Setting Powered False 03:56:01.481289 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 03:56:02.629491 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:02.641828 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:56:02.696056 tst mo_mt_call_osmux.py: using LAC 25818 03:56:02.822530 tst mo_mt_call_osmux.py: using RAC 63 03:56:02.950228 tst mo_mt_call_osmux.py: using CellId 25818 03:56:03.077082 tst mo_mt_call_osmux.py: using BVCI 25819 03:56:03.193956 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:03.205835 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:03.217517 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:03.229397 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:03.241129 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:03.252942 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:03.369934 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:03.491365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:03.962370 run create_hlr_db(pid=23552): Launched 03:56:04.078574 bus /sierra_2: Setting Powered False 03:56:05.138847 run create_hlr_db(pid=23552): Terminated: ok {rc=0} 03:56:05.580758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23554): Launched 03:56:05.903530 run osmo-hlr_10.42.42.2(pid=23555): Launched 03:56:06.026254 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:06.585317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23557): Launched 03:56:06.906915 run osmo-stp_10.42.42.5(pid=23558): Launched 03:56:07.029504 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:07.613185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23560): Launched 03:56:07.933943 run osmo-msc_10.42.42.6(pid=23561): Launched 03:56:08.113115 run osmo-stp_10.42.42.5(pid=23558): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23558)] 03:56:08.249036 run osmo-stp_10.42.42.5(pid=23558): stdout: | (launched: 2022-12-10_03:56:06.848338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:08.385204 run osmo-stp_10.42.42.5(pid=23558): stderr: | 20221210035607039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035607039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035607039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035607039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035607042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035607042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035607042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:08.519848 run osmo-stp_10.42.42.5(pid=23558): stdout: | (launched: 2022-12-10_03:56:06.848338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:08.647969 run osmo-stp_10.42.42.5(pid=23558): stderr: | 20221210035607039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035607039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035607039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035607039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035607042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035607042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035607042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:08.801340 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23558): Process ended prematurely: osmo-stp_10.42.42.5(pid=23558) [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23558)] [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 03:56:08.811037 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:56:08.838777 run osmo-hlr_10.42.42.2(pid=23555): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23555)] 03:56:08.888758 run osmo-hlr_10.42.42.2(pid=23555): stdout: | (launched: 2022-12-10_03:56:05.845054) 03:56:08.940253 run osmo-hlr_10.42.42.2(pid=23555): stderr: | 20221210035606041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035606041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035606041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035606041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035606041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035606042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035606054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035606063 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035606063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035606063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:09.012071 run osmo-msc_10.42.42.6(pid=23561): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23561)] 03:56:09.061810 run osmo-msc_10.42.42.6(pid=23561): stdout: | (launched: 2022-12-10_03:56:07.875436) 03:56:09.113184 run osmo-msc_10.42.42.6(pid=23561): stderr: | 20221210035608197 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035608197 DLGLOBAL DEBUG validating counter group 0x7fb23a2b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035608198 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035608198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035608198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035608198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035608200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035608200 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035608200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035608200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:09.164555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23554): Terminating (SIGTERM) 03:56:09.205851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23557): Terminating (SIGTERM) 03:56:09.247997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23560): Terminating (SIGTERM) 03:56:09.290017 --- ParallelTerminationStrategy: PID 23554 died... 03:56:09.309997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23554): Terminated: ok {rc=0} 03:56:09.356044 --- ParallelTerminationStrategy: PID 23557 died... 03:56:09.375551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23557): Terminated: ok {rc=0} 03:56:09.421580 --- ParallelTerminationStrategy: PID 23560 died... 03:56:09.441206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23560): Terminated: ok {rc=0} 03:56:09.528334 bus /sierra_3: Setting Powered False 03:56:10.628128 bus /sierra_3: Setting Powered False 03:56:11.745297 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:trx-b200 --------------------------------------------------------------------- 03:56:13.000617 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:13.005322 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 03:56:13.039129 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:56:13.066582 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 03:56:13.153449 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 03:56:13.187059 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:56:13.214278 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 03:56:13.799378 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 03:56:13.804498 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:13.815648 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 03:56:13.866536 tst emergency_mo_mt_call.py: using LAC 25819 03:56:13.990579 tst emergency_mo_mt_call.py: using RAC 64 03:56:14.114723 tst emergency_mo_mt_call.py: using CellId 25819 03:56:14.240871 tst emergency_mo_mt_call.py: using BVCI 25820 03:56:14.355744 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:14.366997 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:14.378042 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:14.388858 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:14.399806 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:14.410719 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:14.524750 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:14.639237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:15.103045 run create_hlr_db(pid=23566): Launched 03:56:15.217547 bus /sierra_2: Setting Powered False 03:56:16.277144 run create_hlr_db(pid=23566): Terminated: ok {rc=0} 03:56:16.763332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23568): Launched 03:56:17.173737 run osmo-hlr_10.42.42.2(pid=23569): Launched 03:56:17.361598 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:17.873218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23571): Launched 03:56:18.171611 run osmo-stp_10.42.42.5(pid=23572): Launched 03:56:18.295661 tst emergency_mo_mt_call.py: using MSISDN 7541 03:56:18.448553 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:18.984598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23574): Launched 03:56:19.282209 run osmo-msc_10.42.42.6(pid=23575): Launched 03:56:19.449645 run osmo-stp_10.42.42.5(pid=23572): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23572)] 03:56:19.576056 run osmo-stp_10.42.42.5(pid=23572): stdout: | (launched: 2022-12-10_03:56:18.117175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:19.702852 run osmo-stp_10.42.42.5(pid=23572): stderr: | 20221210035618285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035618285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035618285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035618286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035618286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035618286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035618286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:19.826762 run osmo-stp_10.42.42.5(pid=23572): stdout: | (launched: 2022-12-10_03:56:18.117175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:19.945328 run osmo-stp_10.42.42.5(pid=23572): stderr: | 20221210035618285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035618285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035618285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035618286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035618286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035618286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035618286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:20.086668 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23572): Process ended prematurely: osmo-stp_10.42.42.5(pid=23572) [trial-2369↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23572)] [trial-2369↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 03:56:20.095172 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 03:56:20.121665 run osmo-hlr_10.42.42.2(pid=23569): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23569)] 03:56:20.169053 run osmo-hlr_10.42.42.2(pid=23569): stdout: | (launched: 2022-12-10_03:56:17.109142) 03:56:20.218149 run osmo-hlr_10.42.42.2(pid=23569): stderr: | 20221210035617314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035617314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035617314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035617314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035617314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035617314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035617330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035617351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035617352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035617352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:20.286819 run osmo-msc_10.42.42.6(pid=23575): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23575)] 03:56:20.334221 run osmo-msc_10.42.42.6(pid=23575): stdout: | (launched: 2022-12-10_03:56:19.227300) 03:56:20.383268 run osmo-msc_10.42.42.6(pid=23575): stderr: | 20221210035619500 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035619500 DLGLOBAL DEBUG validating counter group 0x7f3d3fef1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035619500 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035619501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035619501 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035619501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035619503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035619503 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035619504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035619504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:20.432634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23568): Terminating (SIGTERM) 03:56:20.472166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23571): Terminating (SIGTERM) 03:56:20.511665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23574): Terminating (SIGTERM) 03:56:20.551589 --- ParallelTerminationStrategy: PID 23568 died... 03:56:20.570603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23568): Terminated: ok {rc=0} 03:56:20.614539 --- ParallelTerminationStrategy: PID 23571 died... 03:56:20.633051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23571): Terminated: ok {rc=0} 03:56:20.676705 --- ParallelTerminationStrategy: PID 23574 died... 03:56:20.695263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23574): Terminated: ok {rc=0} 03:56:20.781284 bus /sierra_3: Setting Powered False 03:56:21.879844 bus /sierra_3: Setting Powered False 03:56:22.993175 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 03:56:24.079962 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:24.091889 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 03:56:24.144598 tst emergency_preemptive_call.py: using LAC 25820 03:56:24.269505 tst emergency_preemptive_call.py: using RAC 65 03:56:24.395303 tst emergency_preemptive_call.py: using CellId 25820 03:56:24.521708 tst emergency_preemptive_call.py: using BVCI 25821 03:56:24.637678 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:24.648790 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:24.659758 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:24.670699 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:24.681644 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:24.692515 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:24.808744 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:24.924505 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:25.037049 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:25.152762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:25.645962 run create_hlr_db(pid=23577): Launched 03:56:25.773968 bus /sierra_2: Setting Powered False 03:56:26.836785 run create_hlr_db(pid=23577): Terminated: ok {rc=0} 03:56:27.279311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23579): Launched 03:56:27.596912 run osmo-hlr_10.42.42.2(pid=23580): Launched 03:56:27.717484 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:28.263013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23582): Launched 03:56:28.579672 run osmo-stp_10.42.42.5(pid=23583): Launched 03:56:28.710605 tst emergency_preemptive_call.py: using MSISDN 7542 03:56:28.872850 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:29.442279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23585): Launched 03:56:29.759277 run osmo-msc_10.42.42.6(pid=23586): Launched 03:56:29.935782 run osmo-stp_10.42.42.5(pid=23583): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23583)] 03:56:30.069488 run osmo-stp_10.42.42.5(pid=23583): stdout: | (launched: 2022-12-10_03:56:28.521874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:30.203379 run osmo-stp_10.42.42.5(pid=23583): stderr: | 20221210035628713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035628714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035628714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035628714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035628715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035628715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035628715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:30.337362 run osmo-stp_10.42.42.5(pid=23583): stdout: | (launched: 2022-12-10_03:56:28.521874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:30.463972 run osmo-stp_10.42.42.5(pid=23583): stderr: | 20221210035628713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035628714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035628714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035628714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035628715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035628715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035628715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:30.615115 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23583): Process ended prematurely: osmo-stp_10.42.42.5(pid=23583) [trial-2369↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23583)] [trial-2369↪emergency:trx-b200↪emergency_preemptive_call.py:32] 03:56:30.624075 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 03:56:30.651641 run osmo-hlr_10.42.42.2(pid=23580): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23580)] 03:56:30.701420 run osmo-hlr_10.42.42.2(pid=23580): stdout: | (launched: 2022-12-10_03:56:27.538731) 03:56:30.752802 run osmo-hlr_10.42.42.2(pid=23580): stderr: | 20221210035627739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035627739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035627739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035627739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035627739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035627740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035627753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035627761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035627762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035627762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:30.824898 run osmo-msc_10.42.42.6(pid=23586): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23586)] 03:56:30.900185 run osmo-msc_10.42.42.6(pid=23586): stdout: | (launched: 2022-12-10_03:56:29.701473) 03:56:30.964422 run osmo-msc_10.42.42.6(pid=23586): stderr: | 20221210035630024 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210035630024 DLGLOBAL DEBUG validating counter group 0x7f5ae00c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210035630024 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210035630024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210035630024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210035630025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210035630026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210035630027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210035630027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210035630027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:31.035142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23579): Terminating (SIGTERM) 03:56:31.088159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23582): Terminating (SIGTERM) 03:56:31.144469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23585): Terminating (SIGTERM) 03:56:31.200612 --- ParallelTerminationStrategy: PID 23579 died... 03:56:31.225438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23579): Terminated: ok {rc=0} 03:56:31.286129 --- ParallelTerminationStrategy: PID 23582 died... 03:56:31.310407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23582): Terminated: ok {rc=0} 03:56:31.369766 --- ParallelTerminationStrategy: PID 23585 died... 03:56:31.395499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23585): Terminated: ok {rc=0} 03:56:31.501921 bus /sierra_9: Setting Powered False 03:56:32.605207 bus /sierra_9: Setting Powered False 03:56:33.719265 bus /sierra_8: Setting Powered False 03:56:34.816562 bus /sierra_8: Setting Powered False 03:56:35.931996 bus /sierra_3: Setting Powered False 03:56:37.030267 bus /sierra_3: Setting Powered False 03:56:38.146401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-b200 --------------------------------------------------------------------- 03:56:39.431565 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:39.437347 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 03:56:39.471987 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 03:56:39.511842 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 03:56:39.599477 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 03:56:39.633101 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 03:56:39.672001 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 03:56:40.266334 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 03:56:40.318859 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.329966 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:56:40.380697 tst cs_paging_gprs_active.py: using LAC 25821 03:56:40.506892 tst cs_paging_gprs_active.py: using RAC 66 03:56:40.631758 tst cs_paging_gprs_active.py: using CellId 25821 03:56:40.756765 tst cs_paging_gprs_active.py: using BVCI 25822 03:56:40.873809 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.884704 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.895645 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.906514 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.917243 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.927859 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.938794 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.949593 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:40.960439 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:56:41.076604 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:56:41.195971 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:56:41.403492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:56:41.710577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23591): Launched 03:56:41.975830 run iperf3-srv_10.42.42.10(pid=23592): Launched 03:56:42.090642 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:56:42.295370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:56:42.600889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23593): Launched 03:56:42.865708 run iperf3-srv_10.42.42.10(pid=23594): Launched 03:56:42.980145 tst cs_paging_gprs_active.py:38: start network... 03:56:43.184801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:43.656727 run create_hlr_db(pid=23595): Launched 03:56:43.779173 bus /sierra_2: Setting Powered False 03:56:44.839816 run create_hlr_db(pid=23595): Terminated: ok {rc=0} 03:56:45.284181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23597): Launched 03:56:45.609380 run osmo-hlr_10.42.42.2(pid=23598): Launched 03:56:45.733534 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:46.380866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23600): Launched 03:56:46.719764 run osmo-stp_10.42.42.5(pid=23601): Launched 03:56:46.877413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:56:47.558126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23603): Launched 03:56:47.682816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:56:47.957683 run patchelf(pid=23604): Launched 03:56:48.138807 run osmo-stp_10.42.42.5(pid=23601): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23601)] 03:56:48.276864 run osmo-stp_10.42.42.5(pid=23601): stdout: | (launched: 2022-12-10_03:56:46.659674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:48.416213 run osmo-stp_10.42.42.5(pid=23601): stderr: | 20221210035647011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035647011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035647011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035647012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035647012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035647012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035647012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:48.555417 run osmo-stp_10.42.42.5(pid=23601): stdout: | (launched: 2022-12-10_03:56:46.659674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:48.688247 run osmo-stp_10.42.42.5(pid=23601): stderr: | 20221210035647011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035647011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035647011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035647012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035647012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035647012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035647012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:48.845893 run patchelf(pid=23604): Terminating (SIGINT) 03:56:49.027490 run patchelf(pid=23604): Terminated: ok {rc=0} 03:56:49.158414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23601): Process ended prematurely: osmo-stp_10.42.42.5(pid=23601) [trial-2369↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23601)] [trial-2369↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 03:56:49.168766 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:56:49.197479 run osmo-hlr_10.42.42.2(pid=23598): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23598)] 03:56:49.247154 run osmo-hlr_10.42.42.2(pid=23598): stdout: | (launched: 2022-12-10_03:56:45.550202) 03:56:49.298542 run osmo-hlr_10.42.42.2(pid=23598): stderr: | 20221210035645751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035645752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035645752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035645752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035645752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035645752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035645764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035645773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035645773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035645773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:49.350337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23591): Terminating (SIGTERM) 03:56:49.391989 run iperf3-srv_10.42.42.10(pid=23592): Terminating (SIGTERM) 03:56:49.433471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23593): Terminating (SIGTERM) 03:56:49.474860 run iperf3-srv_10.42.42.10(pid=23594): Terminating (SIGTERM) 03:56:49.515995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23597): Terminating (SIGTERM) 03:56:49.557620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23600): Terminating (SIGTERM) 03:56:49.599309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23603): Terminating (SIGTERM) 03:56:49.641260 --- ParallelTerminationStrategy: PID 23591 died... 03:56:49.661276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23591): Terminated: ok {rc=0} 03:56:49.707432 --- ParallelTerminationStrategy: PID 23592 died... 03:56:49.726772 run iperf3-srv_10.42.42.10(pid=23592): Terminated {rc=256} 03:56:49.772347 --- ParallelTerminationStrategy: PID 23593 died... 03:56:49.791602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23593): Terminated: ok {rc=0} 03:56:49.837288 --- ParallelTerminationStrategy: PID 23594 died... 03:56:49.856623 run iperf3-srv_10.42.42.10(pid=23594): Terminated {rc=256} 03:56:49.901971 --- ParallelTerminationStrategy: PID 23597 died... 03:56:49.921406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23597): Terminated: ok {rc=0} 03:56:49.967075 --- ParallelTerminationStrategy: PID 23600 died... 03:56:49.986491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23600): Terminated: ok {rc=0} 03:56:50.032649 --- ParallelTerminationStrategy: PID 23603 died... 03:56:50.052181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23603): Terminated: ok {rc=0} 03:56:50.139482 bus /gobi_0: Setting Powered False 03:56:51.238319 bus /gobi_0: Setting Powered False 03:56:52.353985 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200 iperf3.py ---------------------------------------------- 03:56:53.503636 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:53.515225 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:56:53.571442 tst iperf3.py: using LAC 25822 03:56:53.697298 tst iperf3.py: using RAC 67 03:56:53.821869 tst iperf3.py: using CellId 25822 03:56:53.949605 tst iperf3.py: using BVCI 25823 03:56:54.068350 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.079626 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.090609 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.101547 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.112317 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.123157 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.134244 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.145076 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:56:54.156077 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:56:54.271784 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:56:54.476875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:56:54.782142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23605): Launched 03:56:55.046690 run iperf3-srv_10.42.42.10(pid=23606): Launched 03:56:55.160719 tst iperf3.py:8: start network... 03:56:55.365818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:55.836509 run create_hlr_db(pid=23607): Launched 03:56:55.969176 bus /gobi_6: Setting Powered False 03:56:57.033664 run create_hlr_db(pid=23607): Terminated: ok {rc=0} 03:56:57.483519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Launched 03:56:57.807074 run osmo-hlr_10.42.42.2(pid=23610): Launched 03:56:57.929697 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:58.486468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Launched 03:56:58.810106 run osmo-stp_10.42.42.5(pid=23613): Launched 03:56:58.933387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:56:59.491735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23615): Launched 03:56:59.615581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:56:59.888919 run patchelf(pid=23616): Launched 03:57:00.067739 run osmo-stp_10.42.42.5(pid=23613): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] 03:57:00.205114 run osmo-stp_10.42.42.5(pid=23613): stdout: | (launched: 2022-12-10_03:56:58.751075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:00.344123 run osmo-stp_10.42.42.5(pid=23613): stderr: | 20221210035658942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035658943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035658943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035658943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035658944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035658944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035658944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:00.483352 run osmo-stp_10.42.42.5(pid=23613): stdout: | (launched: 2022-12-10_03:56:58.751075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:00.615717 run osmo-stp_10.42.42.5(pid=23613): stderr: | 20221210035658942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035658943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035658943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035658943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035658944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035658944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035658944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:00.772199 run patchelf(pid=23616): Terminating (SIGINT) 03:57:00.955088 run patchelf(pid=23616): Terminated: ok {rc=0} 03:57:01.088010 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23613): Process ended prematurely: osmo-stp_10.42.42.5(pid=23613) [trial-2369↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] [trial-2369↪gprs:trx-b200↪iperf3.py:8] 03:57:01.099551 tst iperf3.py:8: Test FAILED (7.6 sec) 03:57:01.129558 run osmo-hlr_10.42.42.2(pid=23610): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23610)] 03:57:01.180506 run osmo-hlr_10.42.42.2(pid=23610): stdout: | (launched: 2022-12-10_03:56:57.748258) 03:57:01.232721 run osmo-hlr_10.42.42.2(pid=23610): stderr: | 20221210035657945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035657945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035657945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035657945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035657945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035657945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035657957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035657965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035657966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035657966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:01.285772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23605): Terminating (SIGTERM) 03:57:01.329183 run iperf3-srv_10.42.42.10(pid=23606): Terminating (SIGTERM) 03:57:01.374812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Terminating (SIGTERM) 03:57:01.418091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Terminating (SIGTERM) 03:57:01.461967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23615): Terminating (SIGTERM) 03:57:01.505293 --- ParallelTerminationStrategy: PID 23605 died... 03:57:01.526970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23605): Terminated: ok {rc=0} 03:57:01.574316 --- ParallelTerminationStrategy: PID 23606 died... 03:57:01.594610 run iperf3-srv_10.42.42.10(pid=23606): Terminated {rc=256} 03:57:01.641993 --- ParallelTerminationStrategy: PID 23609 died... 03:57:01.661941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Terminated: ok {rc=0} 03:57:01.709265 --- ParallelTerminationStrategy: PID 23612 died... 03:57:01.729269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Terminated: ok {rc=0} 03:57:01.776301 --- ParallelTerminationStrategy: PID 23615 died... 03:57:01.796475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23615): Terminated: ok {rc=0} 03:57:01.886013 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 03:57:03.036252 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.047391 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:03.096907 tst iperf3m4.py: using LAC 25823 03:57:03.217981 tst iperf3m4.py: using RAC 68 03:57:03.339282 tst iperf3m4.py: using CellId 25823 03:57:03.462456 tst iperf3m4.py: using BVCI 25824 03:57:03.574211 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.584778 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.595272 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.606403 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.617489 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.628436 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.639732 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.650946 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:03.662385 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:03.781986 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:03.900691 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:04.017938 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:04.131859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:57:04.337049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:04.642774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23617): Launched 03:57:04.908130 run iperf3-srv_10.42.42.10(pid=23618): Launched 03:57:05.022684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:57:05.228080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:05.534937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23619): Launched 03:57:05.800573 run iperf3-srv_10.42.42.10(pid=23620): Launched 03:57:05.914974 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:57:06.119698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:06.425149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23621): Launched 03:57:06.689637 run iperf3-srv_10.42.42.10(pid=23622): Launched 03:57:06.803366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:57:07.006593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:07.311525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23623): Launched 03:57:07.576565 run iperf3-srv_10.42.42.10(pid=23624): Launched 03:57:07.690683 tst iperf3m4.py:8: start network... 03:57:07.895502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:08.365902 run create_hlr_db(pid=23625): Launched 03:57:08.481438 bus /gobi_6: Setting Powered False 03:57:09.542147 run create_hlr_db(pid=23625): Terminated: ok {rc=0} 03:57:09.966161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23627): Launched 03:57:10.270328 run osmo-hlr_10.42.42.2(pid=23628): Launched 03:57:10.386359 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:10.921124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23630): Launched 03:57:11.225468 run osmo-stp_10.42.42.5(pid=23631): Launched 03:57:11.341371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:11.876756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23633): Launched 03:57:11.993412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:12.250359 run patchelf(pid=23634): Launched 03:57:12.418869 run osmo-stp_10.42.42.5(pid=23631): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23631)] 03:57:12.548360 run osmo-stp_10.42.42.5(pid=23631): stdout: | (launched: 2022-12-10_03:57:11.169410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:12.679390 run osmo-stp_10.42.42.5(pid=23631): stderr: | 20221210035711340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035711341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035711341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035711341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035711342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035711342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035711342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:12.810953 run osmo-stp_10.42.42.5(pid=23631): stdout: | (launched: 2022-12-10_03:57:11.169410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:12.936195 run osmo-stp_10.42.42.5(pid=23631): stderr: | 20221210035711340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035711341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035711341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035711341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035711342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035711342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035711342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:13.084701 run patchelf(pid=23634): Terminating (SIGINT) 03:57:13.255652 run patchelf(pid=23634): Terminated: ok {rc=0} 03:57:13.379135 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23631): Process ended prematurely: osmo-stp_10.42.42.5(pid=23631) [trial-2369↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23631)] [trial-2369↪gprs:trx-b200↪iperf3m4.py:8] 03:57:13.388764 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:57:13.416576 run osmo-hlr_10.42.42.2(pid=23628): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23628)] 03:57:13.463983 run osmo-hlr_10.42.42.2(pid=23628): stdout: | (launched: 2022-12-10_03:57:10.214593) 03:57:13.513093 run osmo-hlr_10.42.42.2(pid=23628): stderr: | 20221210035710389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035710389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035710389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035710389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035710389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035710389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035710401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035710410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035710410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035710410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:13.562481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23617): Terminating (SIGTERM) 03:57:13.601687 run iperf3-srv_10.42.42.10(pid=23618): Terminating (SIGTERM) 03:57:13.640860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23619): Terminating (SIGTERM) 03:57:13.681311 run iperf3-srv_10.42.42.10(pid=23620): Terminating (SIGTERM) 03:57:13.720882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23621): Terminating (SIGTERM) 03:57:13.760703 run iperf3-srv_10.42.42.10(pid=23622): Terminating (SIGTERM) 03:57:13.800094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23623): Terminating (SIGTERM) 03:57:13.839516 run iperf3-srv_10.42.42.10(pid=23624): Terminating (SIGTERM) 03:57:13.878687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23627): Terminating (SIGTERM) 03:57:13.918074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23630): Terminating (SIGTERM) 03:57:13.957360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23633): Terminating (SIGTERM) 03:57:13.997055 --- ParallelTerminationStrategy: PID 23617 died... 03:57:14.015953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23617): Terminated: ok {rc=0} 03:57:14.060258 --- ParallelTerminationStrategy: PID 23618 died... 03:57:14.078722 run iperf3-srv_10.42.42.10(pid=23618): Terminated {rc=256} 03:57:14.122392 --- ParallelTerminationStrategy: PID 23619 died... 03:57:14.140738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23619): Terminated: ok {rc=0} 03:57:14.184434 --- ParallelTerminationStrategy: PID 23620 died... 03:57:14.202922 run iperf3-srv_10.42.42.10(pid=23620): Terminated {rc=256} 03:57:14.246437 --- ParallelTerminationStrategy: PID 23621 died... 03:57:14.264676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23621): Terminated: ok {rc=0} 03:57:14.308845 --- ParallelTerminationStrategy: PID 23622 died... 03:57:14.327524 run iperf3-srv_10.42.42.10(pid=23622): Terminated {rc=256} 03:57:14.371682 --- ParallelTerminationStrategy: PID 23623 died... 03:57:14.389954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23623): Terminated: ok {rc=0} 03:57:14.433699 --- ParallelTerminationStrategy: PID 23624 died... 03:57:14.451912 run iperf3-srv_10.42.42.10(pid=23624): Terminated {rc=256} 03:57:14.495448 --- ParallelTerminationStrategy: PID 23627 died... 03:57:14.513769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23627): Terminated: ok {rc=0} 03:57:14.557295 --- ParallelTerminationStrategy: PID 23630 died... 03:57:14.575732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23630): Terminated: ok {rc=0} 03:57:14.619338 --- ParallelTerminationStrategy: PID 23633 died... 03:57:14.637680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23633): Terminated: ok {rc=0} 03:57:14.723089 bus /gobi_4: Setting Powered False 03:57:15.823694 bus /gobi_4: Setting Powered False 03:57:16.967333 bus /gobi_1: Setting Powered False 03:57:18.066943 bus /gobi_1: Setting Powered False 03:57:19.183991 bus /gobi_0: Setting Powered False 03:57:20.282099 bus /gobi_0: Setting Powered False 03:57:21.394630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200 ping.py ---------------------------------------------- 03:57:22.496812 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:22.508649 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:22.558815 tst ping.py: using LAC 25824 03:57:22.678980 tst ping.py: using RAC 69 03:57:22.795983 tst ping.py: using CellId 25824 03:57:22.916123 tst ping.py: using BVCI 25825 03:57:23.026207 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:23.036793 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:23.047291 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:23.057970 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:23.068449 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:23.079071 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:23.089836 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:23.100452 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:23.216663 tst ping.py:19: start network... 03:57:23.431673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:23.923222 run create_hlr_db(pid=23635): Launched 03:57:24.051452 bus /gobi_6: Setting Powered False 03:57:25.114506 run create_hlr_db(pid=23635): Terminated: ok {rc=0} 03:57:25.541520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23637): Launched 03:57:25.841064 run osmo-hlr_10.42.42.2(pid=23638): Launched 03:57:25.955399 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:26.474929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23640): Launched 03:57:26.773670 run osmo-stp_10.42.42.5(pid=23641): Launched 03:57:26.886933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:27.402290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23643): Launched 03:57:27.516810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:27.769774 run patchelf(pid=23644): Launched 03:57:27.936849 run osmo-stp_10.42.42.5(pid=23641): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23641)] 03:57:28.063984 run osmo-stp_10.42.42.5(pid=23641): stdout: | (launched: 2022-12-10_03:57:26.718736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:28.192322 run osmo-stp_10.42.42.5(pid=23641): stderr: | 20221210035726887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035726887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035726887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035726887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035726888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035726888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035726888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:28.321146 run osmo-stp_10.42.42.5(pid=23641): stdout: | (launched: 2022-12-10_03:57:26.718736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:28.443743 run osmo-stp_10.42.42.5(pid=23641): stderr: | 20221210035726887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035726887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035726887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035726887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035726888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035726888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035726888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:28.589234 run patchelf(pid=23644): Terminating (SIGINT) 03:57:28.757674 run patchelf(pid=23644): Terminated: ok {rc=0} 03:57:28.878943 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23641): Process ended prematurely: osmo-stp_10.42.42.5(pid=23641) [trial-2369↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23641)] [trial-2369↪gprs:trx-b200↪ping.py:22] 03:57:28.887988 tst ping.py:22: Test FAILED (6.4 sec) 03:57:28.915390 run osmo-hlr_10.42.42.2(pid=23638): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23638)] 03:57:28.963430 run osmo-hlr_10.42.42.2(pid=23638): stdout: | (launched: 2022-12-10_03:57:25.785548) 03:57:29.014893 run osmo-hlr_10.42.42.2(pid=23638): stderr: | 20221210035725961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035725961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035725962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035725962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035725962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035725962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035725974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035725983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035725983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035725983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:29.064616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23637): Terminating (SIGTERM) 03:57:29.104915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23640): Terminating (SIGTERM) 03:57:29.145165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23643): Terminating (SIGTERM) 03:57:29.185991 --- ParallelTerminationStrategy: PID 23637 died... 03:57:29.205155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23637): Terminated: ok {rc=0} 03:57:29.249609 --- ParallelTerminationStrategy: PID 23640 died... 03:57:29.268354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23640): Terminated: ok {rc=0} 03:57:29.312540 --- ParallelTerminationStrategy: PID 23643 died... 03:57:29.331212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23643): Terminated: ok {rc=0} 03:57:29.414799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 03:57:30.501434 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:30.513997 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:30.565782 tst ping_idle_ping.py: using LAC 25825 03:57:30.692365 tst ping_idle_ping.py: using RAC 70 03:57:30.817299 tst ping_idle_ping.py: using CellId 25825 03:57:30.954079 tst ping_idle_ping.py: using BVCI 25826 03:57:31.071206 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:31.082797 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:31.094423 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:31.106831 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:31.118701 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:31.131119 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:31.143436 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:31.157075 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:31.278713 tst ping_idle_ping.py:24: start network... 03:57:31.503024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:32.017790 run create_hlr_db(pid=23645): Launched 03:57:32.177618 bus /gobi_6: Setting Powered False 03:57:33.241060 run create_hlr_db(pid=23645): Terminated: ok {rc=0} 03:57:33.670236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23647): Launched 03:57:33.970882 run osmo-hlr_10.42.42.2(pid=23648): Launched 03:57:34.083738 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:34.610424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23650): Launched 03:57:34.909441 run osmo-stp_10.42.42.5(pid=23651): Launched 03:57:35.023383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:35.539659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23653): Launched 03:57:35.653705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:35.906891 run patchelf(pid=23654): Launched 03:57:36.078317 run osmo-stp_10.42.42.5(pid=23651): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23651)] 03:57:36.205242 run osmo-stp_10.42.42.5(pid=23651): stdout: | (launched: 2022-12-10_03:57:34.854238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:36.333558 run osmo-stp_10.42.42.5(pid=23651): stderr: | 20221210035735024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035735025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035735025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035735025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035735026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035735026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035735026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:36.462714 run osmo-stp_10.42.42.5(pid=23651): stdout: | (launched: 2022-12-10_03:57:34.854238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:36.585222 run osmo-stp_10.42.42.5(pid=23651): stderr: | 20221210035735024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035735025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035735025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035735025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035735026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035735026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035735026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:36.730969 run patchelf(pid=23654): Terminating (SIGINT) 03:57:36.898715 run patchelf(pid=23654): Terminated: ok {rc=0} 03:57:37.020133 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23651): Process ended prematurely: osmo-stp_10.42.42.5(pid=23651) [trial-2369↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23651)] [trial-2369↪gprs:trx-b200↪ping_idle_ping.py:27] 03:57:37.029302 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:57:37.056624 run osmo-hlr_10.42.42.2(pid=23648): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23648)] 03:57:37.103924 run osmo-hlr_10.42.42.2(pid=23648): stdout: | (launched: 2022-12-10_03:57:33.915438) 03:57:37.152493 run osmo-hlr_10.42.42.2(pid=23648): stderr: | 20221210035734093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035734093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035734093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035734093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035734093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035734093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035734105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035734115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035734115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035734116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:37.201863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23647): Terminating (SIGTERM) 03:57:37.241233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23650): Terminating (SIGTERM) 03:57:37.280741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23653): Terminating (SIGTERM) 03:57:37.320483 --- ParallelTerminationStrategy: PID 23647 died... 03:57:37.339494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23647): Terminated: ok {rc=0} 03:57:37.383856 --- ParallelTerminationStrategy: PID 23650 died... 03:57:37.402196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23650): Terminated: ok {rc=0} 03:57:37.446046 --- ParallelTerminationStrategy: PID 23653 died... 03:57:37.464546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23653): Terminated: ok {rc=0} 03:57:37.549450 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 03:57:38.853631 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:57:38.858759 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:57:38.891741 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:57:38.929756 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:57:39.015631 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:57:39.048065 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:57:39.085947 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:57:39.678620 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:57:39.728096 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:39.738865 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:57:39.788043 tst cs_paging_gprs_active.py: using LAC 25826 03:57:39.908502 tst cs_paging_gprs_active.py: using RAC 71 03:57:40.037089 tst cs_paging_gprs_active.py: using CellId 25826 03:57:40.164048 tst cs_paging_gprs_active.py: using BVCI 25827 03:57:40.282475 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.294054 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.305386 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.316839 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.328207 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.339642 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.351299 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.362751 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:40.374135 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:57:40.489834 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:57:40.609216 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:57:40.829268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:41.153978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23659): Launched 03:57:41.435753 run iperf3-srv_10.42.42.10(pid=23660): Launched 03:57:41.557182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:57:41.776433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:42.102493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23661): Launched 03:57:42.384262 run iperf3-srv_10.42.42.10(pid=23662): Launched 03:57:42.505454 tst cs_paging_gprs_active.py:38: start network... 03:57:42.724359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:43.224821 run create_hlr_db(pid=23663): Launched 03:57:43.356593 bus /gobi_6: Setting Powered False 03:57:44.421260 run create_hlr_db(pid=23663): Terminated: ok {rc=0} 03:57:44.854676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23665): Launched 03:57:45.159237 run osmo-hlr_10.42.42.2(pid=23666): Launched 03:57:45.276246 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:45.811485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23668): Launched 03:57:46.173357 run osmo-stp_10.42.42.5(pid=23669): Launched 03:57:46.415306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:47.113794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23671): Launched 03:57:47.240752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:47.498864 run patchelf(pid=23672): Launched 03:57:47.668187 run osmo-stp_10.42.42.5(pid=23669): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23669)] 03:57:47.797392 run osmo-stp_10.42.42.5(pid=23669): stdout: | (launched: 2022-12-10_03:57:46.110214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:47.928112 run osmo-stp_10.42.42.5(pid=23669): stderr: | 20221210035746435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035746436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035746436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035746436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035746449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035746449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035746449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:48.059087 run osmo-stp_10.42.42.5(pid=23669): stdout: | (launched: 2022-12-10_03:57:46.110214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:48.183770 run osmo-stp_10.42.42.5(pid=23669): stderr: | 20221210035746435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035746436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035746436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035746436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035746449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035746449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035746449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:48.331582 run patchelf(pid=23672): Terminating (SIGINT) 03:57:48.503339 run patchelf(pid=23672): Terminated: ok {rc=0} 03:57:48.627178 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23669): Process ended prematurely: osmo-stp_10.42.42.5(pid=23669) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23669)] [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:57:48.636802 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:57:48.664362 run osmo-hlr_10.42.42.2(pid=23666): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23666)] 03:57:48.711844 run osmo-hlr_10.42.42.2(pid=23666): stdout: | (launched: 2022-12-10_03:57:45.103706) 03:57:48.761149 run osmo-hlr_10.42.42.2(pid=23666): stderr: | 20221210035745280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035745280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035745280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035745280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035745280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035745280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035745294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035745304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035745304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035745304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:48.810569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23659): Terminating (SIGTERM) 03:57:48.850376 run iperf3-srv_10.42.42.10(pid=23660): Terminating (SIGTERM) 03:57:48.890145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23661): Terminating (SIGTERM) 03:57:48.929845 run iperf3-srv_10.42.42.10(pid=23662): Terminating (SIGTERM) 03:57:48.969332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23665): Terminating (SIGTERM) 03:57:49.009686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23668): Terminating (SIGTERM) 03:57:49.049429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23671): Terminating (SIGTERM) 03:57:49.089733 --- ParallelTerminationStrategy: PID 23659 died... 03:57:49.108643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23659): Terminated: ok {rc=0} 03:57:49.152571 --- ParallelTerminationStrategy: PID 23660 died... 03:57:49.170968 run iperf3-srv_10.42.42.10(pid=23660): Terminated {rc=256} 03:57:49.214469 --- ParallelTerminationStrategy: PID 23661 died... 03:57:49.232774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23661): Terminated: ok {rc=0} 03:57:49.276477 --- ParallelTerminationStrategy: PID 23662 died... 03:57:49.294720 run iperf3-srv_10.42.42.10(pid=23662): Terminated {rc=256} 03:57:49.338216 --- ParallelTerminationStrategy: PID 23665 died... 03:57:49.356440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23665): Terminated: ok {rc=0} 03:57:49.400218 --- ParallelTerminationStrategy: PID 23668 died... 03:57:49.418743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23668): Terminated: ok {rc=0} 03:57:49.462374 --- ParallelTerminationStrategy: PID 23671 died... 03:57:49.480666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23671): Terminated: ok {rc=0} 03:57:49.567057 bus /gobi_0: Setting Powered False 03:57:50.665542 bus /gobi_0: Setting Powered False 03:57:51.780174 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:57:52.929194 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:52.940999 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:57:52.995362 tst iperf3.py: using LAC 25827 03:57:53.123625 tst iperf3.py: using RAC 72 03:57:53.249624 tst iperf3.py: using CellId 25827 03:57:53.377665 tst iperf3.py: using BVCI 25828 03:57:53.495815 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.507164 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.518242 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.529361 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.540395 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.551413 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.563074 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.574056 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:57:53.585527 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:57:53.703425 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:57:53.923755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:54.249572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23673): Launched 03:57:54.531762 run iperf3-srv_10.42.42.10(pid=23674): Launched 03:57:54.653944 tst iperf3.py:8: start network... 03:57:54.873007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:55.375551 run create_hlr_db(pid=23675): Launched 03:57:55.506179 bus /gobi_6: Setting Powered False 03:57:56.570650 run create_hlr_db(pid=23675): Terminated: ok {rc=0} 03:57:57.019867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23677): Launched 03:57:57.344022 run osmo-hlr_10.42.42.2(pid=23678): Launched 03:57:57.467371 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:58.022668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23680): Launched 03:57:58.347309 run osmo-stp_10.42.42.5(pid=23681): Launched 03:57:58.470775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:59.027542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23683): Launched 03:57:59.151226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:59.424402 run patchelf(pid=23684): Launched 03:57:59.603712 run osmo-stp_10.42.42.5(pid=23681): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23681)] 03:57:59.741643 run osmo-stp_10.42.42.5(pid=23681): stdout: | (launched: 2022-12-10_03:57:58.287978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:59.880917 run osmo-stp_10.42.42.5(pid=23681): stderr: | 20221210035758479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035758479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035758480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035758480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035758482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035758482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035758483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:00.019760 run osmo-stp_10.42.42.5(pid=23681): stdout: | (launched: 2022-12-10_03:57:58.287978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:00.153131 run osmo-stp_10.42.42.5(pid=23681): stderr: | 20221210035758479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035758479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035758480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035758480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035758482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035758482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035758483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:00.310774 run patchelf(pid=23684): Terminating (SIGINT) 03:58:00.492023 run patchelf(pid=23684): Terminated: ok {rc=0} 03:58:00.622729 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23681): Process ended prematurely: osmo-stp_10.42.42.5(pid=23681) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23681)] [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 03:58:00.633047 tst iperf3.py:8: Test FAILED (7.7 sec) 03:58:00.661365 run osmo-hlr_10.42.42.2(pid=23678): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23678)] 03:58:00.711039 run osmo-hlr_10.42.42.2(pid=23678): stdout: | (launched: 2022-12-10_03:57:57.284580) 03:58:00.762123 run osmo-hlr_10.42.42.2(pid=23678): stderr: | 20221210035757484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035757484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035757484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035757484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035757484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035757484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035757496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035757504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035757504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035757504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:00.813838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23673): Terminating (SIGTERM) 03:58:00.861287 run iperf3-srv_10.42.42.10(pid=23674): Terminating (SIGTERM) 03:58:00.914877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23677): Terminating (SIGTERM) 03:58:00.967629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23680): Terminating (SIGTERM) 03:58:01.009986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23683): Terminating (SIGTERM) 03:58:01.052890 --- ParallelTerminationStrategy: PID 23673 died... 03:58:01.072929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23673): Terminated: ok {rc=0} 03:58:01.119942 --- ParallelTerminationStrategy: PID 23674 died... 03:58:01.139863 run iperf3-srv_10.42.42.10(pid=23674): Terminated {rc=256} 03:58:01.186516 --- ParallelTerminationStrategy: PID 23677 died... 03:58:01.206396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23677): Terminated: ok {rc=0} 03:58:01.253219 --- ParallelTerminationStrategy: PID 23680 died... 03:58:01.273253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23680): Terminated: ok {rc=0} 03:58:01.320324 --- ParallelTerminationStrategy: PID 23683 died... 03:58:01.340396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23683): Terminated: ok {rc=0} 03:58:01.429745 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:58:02.578641 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:02.590927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:02.643062 tst iperf3m4.py: using LAC 25828 03:58:02.770805 tst iperf3m4.py: using RAC 73 03:58:02.897630 tst iperf3m4.py: using CellId 25828 03:58:03.024663 tst iperf3m4.py: using BVCI 25829 03:58:03.142495 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.154018 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.165225 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.176435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.187570 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.198892 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.210324 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.221393 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:03.232591 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:03.350626 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:03.473544 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:03.591625 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:03.709537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:58:03.914675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:04.219750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23685): Launched 03:58:04.484618 run iperf3-srv_10.42.42.10(pid=23686): Launched 03:58:04.598511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:58:04.802515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:05.107570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Launched 03:58:05.372517 run iperf3-srv_10.42.42.10(pid=23688): Launched 03:58:05.486447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:58:05.690755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:05.995754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23689): Launched 03:58:06.260633 run iperf3-srv_10.42.42.10(pid=23690): Launched 03:58:06.374422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:58:06.578897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:06.883557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23691): Launched 03:58:07.147581 run iperf3-srv_10.42.42.10(pid=23692): Launched 03:58:07.260903 tst iperf3m4.py:8: start network... 03:58:07.464089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:07.933140 run create_hlr_db(pid=23693): Launched 03:58:08.048891 bus /gobi_6: Setting Powered False 03:58:09.108425 run create_hlr_db(pid=23693): Terminated: ok {rc=0} 03:58:09.531292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23695): Launched 03:58:09.835284 run osmo-hlr_10.42.42.2(pid=23696): Launched 03:58:09.951746 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:10.479028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23698): Launched 03:58:10.783124 run osmo-stp_10.42.42.5(pid=23699): Launched 03:58:10.899878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:11.425191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23701): Launched 03:58:11.542192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:11.799965 run patchelf(pid=23702): Launched 03:58:11.969467 run osmo-stp_10.42.42.5(pid=23699): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23699)] 03:58:12.098620 run osmo-stp_10.42.42.5(pid=23699): stdout: | (launched: 2022-12-10_03:58:10.727296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:12.229818 run osmo-stp_10.42.42.5(pid=23699): stderr: | 20221210035810897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035810897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035810897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035810897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035810898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035810898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035810898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:12.360839 run osmo-stp_10.42.42.5(pid=23699): stdout: | (launched: 2022-12-10_03:58:10.727296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:12.485922 run osmo-stp_10.42.42.5(pid=23699): stderr: | 20221210035810897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035810897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035810897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035810897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035810898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035810898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035810898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:12.634020 run patchelf(pid=23702): Terminating (SIGINT) 03:58:12.805100 run patchelf(pid=23702): Terminated: ok {rc=0} 03:58:12.928599 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23699): Process ended prematurely: osmo-stp_10.42.42.5(pid=23699) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23699)] [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 03:58:12.938456 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:58:12.966416 run osmo-hlr_10.42.42.2(pid=23696): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23696)] 03:58:13.013867 run osmo-hlr_10.42.42.2(pid=23696): stdout: | (launched: 2022-12-10_03:58:09.779422) 03:58:13.062951 run osmo-hlr_10.42.42.2(pid=23696): stderr: | 20221210035809958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035809958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035809958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035809958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035809958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035809958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035809970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035809978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035809979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035809979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:13.112485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23685): Terminating (SIGTERM) 03:58:13.152154 run iperf3-srv_10.42.42.10(pid=23686): Terminating (SIGTERM) 03:58:13.191948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Terminating (SIGTERM) 03:58:13.232163 run iperf3-srv_10.42.42.10(pid=23688): Terminating (SIGTERM) 03:58:13.271959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23689): Terminating (SIGTERM) 03:58:13.311639 run iperf3-srv_10.42.42.10(pid=23690): Terminating (SIGTERM) 03:58:13.351689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23691): Terminating (SIGTERM) 03:58:13.391476 run iperf3-srv_10.42.42.10(pid=23692): Terminating (SIGTERM) 03:58:13.431150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23695): Terminating (SIGTERM) 03:58:13.470955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23698): Terminating (SIGTERM) 03:58:13.510655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23701): Terminating (SIGTERM) 03:58:13.550656 --- ParallelTerminationStrategy: PID 23685 died... 03:58:13.569719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23685): Terminated: ok {rc=0} 03:58:13.614059 --- ParallelTerminationStrategy: PID 23686 died... 03:58:13.632522 run iperf3-srv_10.42.42.10(pid=23686): Terminated {rc=256} 03:58:13.676531 --- ParallelTerminationStrategy: PID 23687 died... 03:58:13.695106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Terminated: ok {rc=0} 03:58:13.738931 --- ParallelTerminationStrategy: PID 23688 died... 03:58:13.757411 run iperf3-srv_10.42.42.10(pid=23688): Terminated {rc=256} 03:58:13.801404 --- ParallelTerminationStrategy: PID 23689 died... 03:58:13.819850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23689): Terminated: ok {rc=0} 03:58:13.864379 --- ParallelTerminationStrategy: PID 23690 died... 03:58:13.882842 run iperf3-srv_10.42.42.10(pid=23690): Terminated {rc=256} 03:58:13.926822 --- ParallelTerminationStrategy: PID 23691 died... 03:58:13.945310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23691): Terminated: ok {rc=0} 03:58:13.989951 --- ParallelTerminationStrategy: PID 23692 died... 03:58:14.008410 run iperf3-srv_10.42.42.10(pid=23692): Terminated {rc=256} 03:58:14.052478 --- ParallelTerminationStrategy: PID 23695 died... 03:58:14.071100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23695): Terminated: ok {rc=0} 03:58:14.115040 --- ParallelTerminationStrategy: PID 23698 died... 03:58:14.133608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23698): Terminated: ok {rc=0} 03:58:14.178307 --- ParallelTerminationStrategy: PID 23701 died... 03:58:14.196813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23701): Terminated: ok {rc=0} 03:58:14.282926 bus /gobi_4: Setting Powered False 03:58:15.381584 bus /gobi_4: Setting Powered False 03:58:16.495929 bus /gobi_1: Setting Powered False 03:58:17.597012 bus /gobi_1: Setting Powered False 03:58:18.714649 bus /gobi_0: Setting Powered False 03:58:19.815321 bus /gobi_0: Setting Powered False 03:58:20.930209 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 03:58:22.033632 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.045347 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:22.097274 tst ping.py: using LAC 25829 03:58:22.221579 tst ping.py: using RAC 74 03:58:22.339571 tst ping.py: using CellId 25829 03:58:22.465471 tst ping.py: using BVCI 25830 03:58:22.581718 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.593290 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.604507 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.616053 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.627419 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.638813 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.650445 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:22.661646 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:22.775338 tst ping.py:19: start network... 03:58:22.976091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:23.439381 run create_hlr_db(pid=23703): Launched 03:58:23.554613 bus /gobi_6: Setting Powered False 03:58:24.614973 run create_hlr_db(pid=23703): Terminated: ok {rc=0} 03:58:25.050923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23705): Launched 03:58:25.372423 run osmo-hlr_10.42.42.2(pid=23706): Launched 03:58:25.494242 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:26.045212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23708): Launched 03:58:26.363042 run osmo-stp_10.42.42.5(pid=23709): Launched 03:58:26.483324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:27.031534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23711): Launched 03:58:27.153041 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:27.422106 run patchelf(pid=23712): Launched 03:58:27.598715 run osmo-stp_10.42.42.5(pid=23709): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23709)] 03:58:27.733131 run osmo-stp_10.42.42.5(pid=23709): stdout: | (launched: 2022-12-10_03:58:26.304389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:27.869302 run osmo-stp_10.42.42.5(pid=23709): stderr: | 20221210035826493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035826493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035826494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035826494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035826496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035826497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035826497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:28.005415 run osmo-stp_10.42.42.5(pid=23709): stdout: | (launched: 2022-12-10_03:58:26.304389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:28.135265 run osmo-stp_10.42.42.5(pid=23709): stderr: | 20221210035826493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035826493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035826494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035826494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035826496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035826497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035826497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:28.289840 run patchelf(pid=23712): Terminating (SIGINT) 03:58:28.468726 run patchelf(pid=23712): Terminated: ok {rc=0} 03:58:28.596776 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23709): Process ended prematurely: osmo-stp_10.42.42.5(pid=23709) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23709)] [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 03:58:28.606594 tst ping.py:22: Test FAILED (6.6 sec) 03:58:28.634565 run osmo-hlr_10.42.42.2(pid=23706): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23706)] 03:58:28.683926 run osmo-hlr_10.42.42.2(pid=23706): stdout: | (launched: 2022-12-10_03:58:25.312769) 03:58:28.734945 run osmo-hlr_10.42.42.2(pid=23706): stderr: | 20221210035825511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035825511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035825511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035825511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035825511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035825511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035825527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035825537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035825537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035825537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:28.786757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23705): Terminating (SIGTERM) 03:58:28.828048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23708): Terminating (SIGTERM) 03:58:28.869402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23711): Terminating (SIGTERM) 03:58:28.911187 --- ParallelTerminationStrategy: PID 23705 died... 03:58:28.931090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23705): Terminated: ok {rc=0} 03:58:28.977165 --- ParallelTerminationStrategy: PID 23708 died... 03:58:28.996507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23708): Terminated: ok {rc=0} 03:58:29.042234 --- ParallelTerminationStrategy: PID 23711 died... 03:58:29.061629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23711): Terminated: ok {rc=0} 03:58:29.148667 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:58:30.236002 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.248418 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:30.301137 tst ping_idle_ping.py: using LAC 25830 03:58:30.430383 tst ping_idle_ping.py: using RAC 75 03:58:30.557398 tst ping_idle_ping.py: using CellId 25830 03:58:30.682652 tst ping_idle_ping.py: using BVCI 25831 03:58:30.798176 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.809637 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.820682 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.840618 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.862736 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.879731 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.891854 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:30.903745 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:31.025527 tst ping_idle_ping.py:24: start network... 03:58:31.278783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:31.825257 run create_hlr_db(pid=23713): Launched 03:58:31.988356 bus /gobi_6: Setting Powered False 03:58:33.051203 run create_hlr_db(pid=23713): Terminated: ok {rc=0} 03:58:33.479245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23715): Launched 03:58:33.780918 run osmo-hlr_10.42.42.2(pid=23716): Launched 03:58:33.895062 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:34.421645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23718): Launched 03:58:34.722561 run osmo-stp_10.42.42.5(pid=23719): Launched 03:58:34.837776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:35.357103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23721): Launched 03:58:35.472506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:35.726822 run patchelf(pid=23722): Launched 03:58:35.894094 run osmo-stp_10.42.42.5(pid=23719): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23719)] 03:58:36.021653 run osmo-stp_10.42.42.5(pid=23719): stdout: | (launched: 2022-12-10_03:58:34.667219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:36.150630 run osmo-stp_10.42.42.5(pid=23719): stderr: | 20221210035834838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035834838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035834838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035834838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035834839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035834839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035834839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:36.279968 run osmo-stp_10.42.42.5(pid=23719): stdout: | (launched: 2022-12-10_03:58:34.667219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:36.403449 run osmo-stp_10.42.42.5(pid=23719): stderr: | 20221210035834838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035834838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035834838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035834838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035834839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035834839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035834839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:36.550072 run patchelf(pid=23722): Terminating (SIGINT) 03:58:36.719170 run patchelf(pid=23722): Terminated: ok {rc=0} 03:58:36.841177 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23719): Process ended prematurely: osmo-stp_10.42.42.5(pid=23719) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23719)] [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 03:58:36.850202 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:58:36.877911 run osmo-hlr_10.42.42.2(pid=23716): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23716)] 03:58:36.925791 run osmo-hlr_10.42.42.2(pid=23716): stdout: | (launched: 2022-12-10_03:58:33.725416) 03:58:36.975439 run osmo-hlr_10.42.42.2(pid=23716): stderr: | 20221210035833902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035833902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035833902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035833902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035833902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035833902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035833914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035833925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035833926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035833926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:37.025779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23715): Terminating (SIGTERM) 03:58:37.065676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23718): Terminating (SIGTERM) 03:58:37.105836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23721): Terminating (SIGTERM) 03:58:37.146231 --- ParallelTerminationStrategy: PID 23715 died... 03:58:37.165451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23715): Terminated: ok {rc=0} 03:58:37.210047 --- ParallelTerminationStrategy: PID 23718 died... 03:58:37.228549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23718): Terminated: ok {rc=0} 03:58:37.273207 --- ParallelTerminationStrategy: PID 23721 died... 03:58:37.291796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23721): Terminated: ok {rc=0} 03:58:37.378245 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:58:38.684655 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:58:38.690763 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:58:38.724667 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:58:38.762795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:58:38.848730 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:58:38.881471 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:58:38.919395 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:58:39.512932 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:58:39.562725 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:39.573571 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:58:39.642586 tst cs_paging_gprs_active.py: using LAC 25831 03:58:39.766407 tst cs_paging_gprs_active.py: using RAC 76 03:58:39.885928 tst cs_paging_gprs_active.py: using CellId 25831 03:58:40.006042 tst cs_paging_gprs_active.py: using BVCI 25832 03:58:40.118760 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.129609 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.140117 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.150993 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.162197 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.173066 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.183998 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.194880 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:40.205830 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:58:40.319578 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:58:40.439167 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:58:40.660201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:40.986879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23726): Launched 03:58:41.268422 run iperf3-srv_10.42.42.10(pid=23727): Launched 03:58:41.390990 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:58:41.610645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:41.935900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23728): Launched 03:58:42.216903 run iperf3-srv_10.42.42.10(pid=23729): Launched 03:58:42.338683 tst cs_paging_gprs_active.py:38: start network... 03:58:42.558747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:43.060670 run create_hlr_db(pid=23730): Launched 03:58:43.192777 bus /gobi_6: Setting Powered False 03:58:44.256607 run create_hlr_db(pid=23730): Terminated: ok {rc=0} 03:58:44.691018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23732): Launched 03:58:44.994903 run osmo-hlr_10.42.42.2(pid=23733): Launched 03:58:45.111222 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:45.633657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23735): Launched 03:58:45.962535 run osmo-stp_10.42.42.5(pid=23736): Launched 03:58:46.094412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:46.777514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23738): Launched 03:58:46.914963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:47.200558 run patchelf(pid=23739): Launched 03:58:47.401407 run osmo-stp_10.42.42.5(pid=23736): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23736)] 03:58:47.539900 run osmo-stp_10.42.42.5(pid=23736): stdout: | (launched: 2022-12-10_03:58:45.899941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:47.679990 run osmo-stp_10.42.42.5(pid=23736): stderr: | 20221210035846271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035846271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035846271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035846272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035846272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035846272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035846272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:47.819641 run osmo-stp_10.42.42.5(pid=23736): stdout: | (launched: 2022-12-10_03:58:45.899941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:47.953259 run osmo-stp_10.42.42.5(pid=23736): stderr: | 20221210035846271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035846271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035846271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035846272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035846272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035846272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035846272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:48.111415 run patchelf(pid=23739): Terminating (SIGINT) 03:58:48.293572 run patchelf(pid=23739): Terminated: ok {rc=0} 03:58:48.425685 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23736): Process ended prematurely: osmo-stp_10.42.42.5(pid=23736) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23736)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:58:48.436260 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:58:48.465850 run osmo-hlr_10.42.42.2(pid=23733): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23733)] 03:58:48.516539 run osmo-hlr_10.42.42.2(pid=23733): stdout: | (launched: 2022-12-10_03:58:44.939320) 03:58:48.569068 run osmo-hlr_10.42.42.2(pid=23733): stderr: | 20221210035845114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035845114 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035845114 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035845114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035845114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035845114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035845126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035845135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035845135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035845135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:48.621561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23726): Terminating (SIGTERM) 03:58:48.663845 run iperf3-srv_10.42.42.10(pid=23727): Terminating (SIGTERM) 03:58:48.705940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23728): Terminating (SIGTERM) 03:58:48.748024 run iperf3-srv_10.42.42.10(pid=23729): Terminating (SIGTERM) 03:58:48.789982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23732): Terminating (SIGTERM) 03:58:48.831999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23735): Terminating (SIGTERM) 03:58:48.873997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23738): Terminating (SIGTERM) 03:58:48.916121 --- ParallelTerminationStrategy: PID 23726 died... 03:58:48.935808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23726): Terminated: ok {rc=0} 03:58:48.982731 --- ParallelTerminationStrategy: PID 23727 died... 03:58:49.002194 run iperf3-srv_10.42.42.10(pid=23727): Terminated {rc=256} 03:58:49.048813 --- ParallelTerminationStrategy: PID 23728 died... 03:58:49.068724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23728): Terminated: ok {rc=0} 03:58:49.115674 --- ParallelTerminationStrategy: PID 23729 died... 03:58:49.135156 run iperf3-srv_10.42.42.10(pid=23729): Terminated {rc=256} 03:58:49.181890 --- ParallelTerminationStrategy: PID 23732 died... 03:58:49.201300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23732): Terminated: ok {rc=0} 03:58:49.247954 --- ParallelTerminationStrategy: PID 23735 died... 03:58:49.267401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23735): Terminated: ok {rc=0} 03:58:49.314430 --- ParallelTerminationStrategy: PID 23738 died... 03:58:49.333816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23738): Terminated: ok {rc=0} 03:58:49.422078 bus /gobi_0: Setting Powered False 03:58:50.518299 bus /gobi_0: Setting Powered False 03:58:51.632526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:58:52.778517 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:52.790103 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:58:52.865433 tst iperf3.py: using LAC 25832 03:58:52.985418 tst iperf3.py: using RAC 77 03:58:53.111062 tst iperf3.py: using CellId 25832 03:58:53.238534 tst iperf3.py: using BVCI 25833 03:58:53.357834 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.369534 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.380740 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.392173 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.403276 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.414485 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.426056 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.437198 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:58:53.448506 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:58:53.563705 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:58:53.768742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:54.074791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23740): Launched 03:58:54.340077 run iperf3-srv_10.42.42.10(pid=23741): Launched 03:58:54.454929 tst iperf3.py:8: start network... 03:58:54.660731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:55.132353 run create_hlr_db(pid=23742): Launched 03:58:55.249654 bus /gobi_6: Setting Powered False 03:58:56.310934 run create_hlr_db(pid=23742): Terminated: ok {rc=0} 03:58:56.735677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23744): Launched 03:58:57.040319 run osmo-hlr_10.42.42.2(pid=23745): Launched 03:58:57.157205 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:57.695610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23747): Launched 03:58:57.998833 run osmo-stp_10.42.42.5(pid=23748): Launched 03:58:58.115342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:58.640904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23750): Launched 03:58:58.757390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:59.013547 run patchelf(pid=23751): Launched 03:58:59.182134 run osmo-stp_10.42.42.5(pid=23748): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23748)] 03:58:59.310916 run osmo-stp_10.42.42.5(pid=23748): stdout: | (launched: 2022-12-10_03:58:57.943482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:59.441206 run osmo-stp_10.42.42.5(pid=23748): stderr: | 20221210035858114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035858114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035858114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035858114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035858115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035858115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035858115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:59.571531 run osmo-stp_10.42.42.5(pid=23748): stdout: | (launched: 2022-12-10_03:58:57.943482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:59.695668 run osmo-stp_10.42.42.5(pid=23748): stderr: | 20221210035858114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035858114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035858114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035858114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035858115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035858115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035858115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:59.843089 run patchelf(pid=23751): Terminating (SIGINT) 03:59:00.013145 run patchelf(pid=23751): Terminated: ok {rc=0} 03:59:00.136397 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23748): Process ended prematurely: osmo-stp_10.42.42.5(pid=23748) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23748)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 03:59:00.146089 tst iperf3.py:8: Test FAILED (7.4 sec) 03:59:00.173858 run osmo-hlr_10.42.42.2(pid=23745): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23745)] 03:59:00.221683 run osmo-hlr_10.42.42.2(pid=23745): stdout: | (launched: 2022-12-10_03:58:56.984663) 03:59:00.270985 run osmo-hlr_10.42.42.2(pid=23745): stderr: | 20221210035857163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035857163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035857163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035857163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035857163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035857163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035857175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035857184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035857184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035857184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:00.320893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23740): Terminating (SIGTERM) 03:59:00.360801 run iperf3-srv_10.42.42.10(pid=23741): Terminating (SIGTERM) 03:59:00.400577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23744): Terminating (SIGTERM) 03:59:00.440517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23747): Terminating (SIGTERM) 03:59:00.480310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23750): Terminating (SIGTERM) 03:59:00.520371 --- ParallelTerminationStrategy: PID 23740 died... 03:59:00.539320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23740): Terminated: ok {rc=0} 03:59:00.583709 --- ParallelTerminationStrategy: PID 23741 died... 03:59:00.602372 run iperf3-srv_10.42.42.10(pid=23741): Terminated {rc=256} 03:59:00.646461 --- ParallelTerminationStrategy: PID 23744 died... 03:59:00.664927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23744): Terminated: ok {rc=0} 03:59:00.709516 --- ParallelTerminationStrategy: PID 23747 died... 03:59:00.727992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23747): Terminated: ok {rc=0} 03:59:00.772008 --- ParallelTerminationStrategy: PID 23750 died... 03:59:00.790549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23750): Terminated: ok {rc=0} 03:59:00.905811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:59:02.056927 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.069457 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:02.142993 tst iperf3m4.py: using LAC 25833 03:59:02.265035 tst iperf3m4.py: using RAC 78 03:59:02.386601 tst iperf3m4.py: using CellId 25833 03:59:02.510485 tst iperf3m4.py: using BVCI 25834 03:59:02.623531 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.634455 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.645273 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.656132 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.667001 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.677920 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.688816 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.699659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:02.710810 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:02.828551 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:02.949117 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:03.064735 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:03.178698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:59:03.384879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:03.691976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Launched 03:59:03.958860 run iperf3-srv_10.42.42.10(pid=23753): Launched 03:59:04.073415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:59:04.279233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:04.585867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Launched 03:59:04.851818 run iperf3-srv_10.42.42.10(pid=23755): Launched 03:59:04.966562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:59:05.171386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:05.477716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23756): Launched 03:59:05.743130 run iperf3-srv_10.42.42.10(pid=23757): Launched 03:59:05.857536 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:59:06.062312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:06.368837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23758): Launched 03:59:06.634875 run iperf3-srv_10.42.42.10(pid=23759): Launched 03:59:06.749273 tst iperf3m4.py:8: start network... 03:59:06.953992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:07.425568 run create_hlr_db(pid=23760): Launched 03:59:07.541538 bus /gobi_6: Setting Powered False 03:59:08.602398 run create_hlr_db(pid=23760): Terminated: ok {rc=0} 03:59:09.027828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23762): Launched 03:59:09.333497 run osmo-hlr_10.42.42.2(pid=23763): Launched 03:59:09.449521 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:09.977462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23765): Launched 03:59:10.281668 run osmo-stp_10.42.42.5(pid=23766): Launched 03:59:10.398291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:10.923270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23768): Launched 03:59:11.039480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:11.297100 run patchelf(pid=23769): Launched 03:59:11.466551 run osmo-stp_10.42.42.5(pid=23766): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23766)] 03:59:11.595733 run osmo-stp_10.42.42.5(pid=23766): stdout: | (launched: 2022-12-10_03:59:10.225544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:11.726737 run osmo-stp_10.42.42.5(pid=23766): stderr: | 20221210035910398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035910398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035910398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035910399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035910399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035910399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035910399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:11.857838 run osmo-stp_10.42.42.5(pid=23766): stdout: | (launched: 2022-12-10_03:59:10.225544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:11.982518 run osmo-stp_10.42.42.5(pid=23766): stderr: | 20221210035910398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035910398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035910398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035910399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035910399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035910399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035910399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:12.130311 run patchelf(pid=23769): Terminating (SIGINT) 03:59:12.301552 run patchelf(pid=23769): Terminated: ok {rc=0} 03:59:12.425714 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23766): Process ended prematurely: osmo-stp_10.42.42.5(pid=23766) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23766)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:59:12.435411 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:59:12.463678 run osmo-hlr_10.42.42.2(pid=23763): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23763)] 03:59:12.511927 run osmo-hlr_10.42.42.2(pid=23763): stdout: | (launched: 2022-12-10_03:59:09.277513) 03:59:12.561634 run osmo-hlr_10.42.42.2(pid=23763): stderr: | 20221210035909454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035909454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035909454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035909454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035909454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035909454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035909467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035909477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035909477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035909478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:12.611749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminating (SIGTERM) 03:59:12.652027 run iperf3-srv_10.42.42.10(pid=23753): Terminating (SIGTERM) 03:59:12.692298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminating (SIGTERM) 03:59:12.732481 run iperf3-srv_10.42.42.10(pid=23755): Terminating (SIGTERM) 03:59:12.772497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23756): Terminating (SIGTERM) 03:59:12.812839 run iperf3-srv_10.42.42.10(pid=23757): Terminating (SIGTERM) 03:59:12.852856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23758): Terminating (SIGTERM) 03:59:12.892764 run iperf3-srv_10.42.42.10(pid=23759): Terminating (SIGTERM) 03:59:12.932609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23762): Terminating (SIGTERM) 03:59:12.972653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23765): Terminating (SIGTERM) 03:59:13.012660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23768): Terminating (SIGTERM) 03:59:13.052875 --- ParallelTerminationStrategy: PID 23752 died... 03:59:13.071993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminated: ok {rc=0} 03:59:13.117236 --- ParallelTerminationStrategy: PID 23753 died... 03:59:13.135768 run iperf3-srv_10.42.42.10(pid=23753): Terminated {rc=256} 03:59:13.180779 --- ParallelTerminationStrategy: PID 23754 died... 03:59:13.199421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminated: ok {rc=0} 03:59:13.244382 --- ParallelTerminationStrategy: PID 23755 died... 03:59:13.263122 run iperf3-srv_10.42.42.10(pid=23755): Terminated {rc=256} 03:59:13.307344 --- ParallelTerminationStrategy: PID 23756 died... 03:59:13.326059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23756): Terminated: ok {rc=0} 03:59:13.370581 --- ParallelTerminationStrategy: PID 23757 died... 03:59:13.389202 run iperf3-srv_10.42.42.10(pid=23757): Terminated {rc=256} 03:59:13.433639 --- ParallelTerminationStrategy: PID 23758 died... 03:59:13.452274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23758): Terminated: ok {rc=0} 03:59:13.497061 --- ParallelTerminationStrategy: PID 23759 died... 03:59:13.515737 run iperf3-srv_10.42.42.10(pid=23759): Terminated {rc=256} 03:59:13.560764 --- ParallelTerminationStrategy: PID 23762 died... 03:59:13.579591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23762): Terminated: ok {rc=0} 03:59:13.624838 --- ParallelTerminationStrategy: PID 23765 died... 03:59:13.644202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23765): Terminated: ok {rc=0} 03:59:13.689329 --- ParallelTerminationStrategy: PID 23768 died... 03:59:13.708024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23768): Terminated: ok {rc=0} 03:59:13.795098 bus /gobi_4: Setting Powered False 03:59:14.894973 bus /gobi_4: Setting Powered False 03:59:16.010366 bus /gobi_1: Setting Powered False 03:59:17.106788 bus /gobi_1: Setting Powered False 03:59:18.222917 bus /gobi_0: Setting Powered False 03:59:19.321551 bus /gobi_0: Setting Powered False 03:59:20.437851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:59:21.541677 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:21.553725 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:21.625089 tst ping.py: using LAC 25834 03:59:21.754996 tst ping.py: using RAC 79 03:59:21.872270 tst ping.py: using CellId 25834 03:59:21.987494 tst ping.py: using BVCI 25835 03:59:22.096523 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:22.107640 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:22.118615 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:22.130013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:22.141284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:22.152497 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:22.164339 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:22.175612 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:22.289798 tst ping.py:19: start network... 03:59:22.491320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:22.956918 run create_hlr_db(pid=23770): Launched 03:59:23.071564 bus /gobi_6: Setting Powered False 03:59:24.131742 run create_hlr_db(pid=23770): Terminated: ok {rc=0} 03:59:24.568924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23772): Launched 03:59:24.888262 run osmo-hlr_10.42.42.2(pid=23773): Launched 03:59:25.010280 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:25.562635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23775): Launched 03:59:25.881612 run osmo-stp_10.42.42.5(pid=23776): Launched 03:59:26.003527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:26.555193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23778): Launched 03:59:26.677720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:26.948660 run patchelf(pid=23779): Launched 03:59:27.125966 run osmo-stp_10.42.42.5(pid=23776): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23776)] 03:59:27.261489 run osmo-stp_10.42.42.5(pid=23776): stdout: | (launched: 2022-12-10_03:59:25.823196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:27.399010 run osmo-stp_10.42.42.5(pid=23776): stderr: | 20221210035926014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035926014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035926014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035926015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035926017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035926017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035926017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:27.535584 run osmo-stp_10.42.42.5(pid=23776): stdout: | (launched: 2022-12-10_03:59:25.823196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:27.666068 run osmo-stp_10.42.42.5(pid=23776): stderr: | 20221210035926014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035926014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035926014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035926015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035926017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035926017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035926017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:27.821020 run patchelf(pid=23779): Terminating (SIGINT) 03:59:27.999197 run patchelf(pid=23779): Terminated: ok {rc=0} 03:59:28.128490 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23776): Process ended prematurely: osmo-stp_10.42.42.5(pid=23776) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23776)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 03:59:28.138216 tst ping.py:22: Test FAILED (6.6 sec) 03:59:28.166636 run osmo-hlr_10.42.42.2(pid=23773): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23773)] 03:59:28.216479 run osmo-hlr_10.42.42.2(pid=23773): stdout: | (launched: 2022-12-10_03:59:24.830050) 03:59:28.268079 run osmo-hlr_10.42.42.2(pid=23773): stderr: | 20221210035925029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035925029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035925029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035925029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035925029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035925029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035925042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035925050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035925050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035925050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:28.320212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23772): Terminating (SIGTERM) 03:59:28.362404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23775): Terminating (SIGTERM) 03:59:28.404326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23778): Terminating (SIGTERM) 03:59:28.446214 --- ParallelTerminationStrategy: PID 23772 died... 03:59:28.466051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23772): Terminated: ok {rc=0} 03:59:28.512702 --- ParallelTerminationStrategy: PID 23775 died... 03:59:28.532627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23775): Terminated: ok {rc=0} 03:59:28.578889 --- ParallelTerminationStrategy: PID 23778 died... 03:59:28.598570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23778): Terminated: ok {rc=0} 03:59:28.685413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:59:29.773212 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:29.784861 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:29.856544 tst ping_idle_ping.py: using LAC 25835 03:59:29.974635 tst ping_idle_ping.py: using RAC 80 03:59:30.097235 tst ping_idle_ping.py: using CellId 25835 03:59:30.214064 tst ping_idle_ping.py: using BVCI 25836 03:59:30.323024 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.334228 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.345586 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.356830 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.368163 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.379552 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.390963 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.402269 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:30.521132 tst ping_idle_ping.py:24: start network... 03:59:30.738192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:31.269802 run create_hlr_db(pid=23780): Launched 03:59:31.435336 bus /gobi_6: Setting Powered False 03:59:32.499500 run create_hlr_db(pid=23780): Terminated: ok {rc=0} 03:59:32.944158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Launched 03:59:33.263533 run osmo-hlr_10.42.42.2(pid=23783): Launched 03:59:33.385776 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:33.938527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Launched 03:59:34.256537 run osmo-stp_10.42.42.5(pid=23786): Launched 03:59:34.378786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:34.928887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23788): Launched 03:59:35.050349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:35.318721 run patchelf(pid=23789): Launched 03:59:35.496037 run osmo-stp_10.42.42.5(pid=23786): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23786)] 03:59:35.631648 run osmo-stp_10.42.42.5(pid=23786): stdout: | (launched: 2022-12-10_03:59:34.198557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:35.768162 run osmo-stp_10.42.42.5(pid=23786): stderr: | 20221210035934390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035934390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035934390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035934391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035934393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035934393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035934393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:35.904731 run osmo-stp_10.42.42.5(pid=23786): stdout: | (launched: 2022-12-10_03:59:34.198557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:36.035543 run osmo-stp_10.42.42.5(pid=23786): stderr: | 20221210035934390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035934390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035934390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035934391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035934393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035934393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035934393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:36.190396 run patchelf(pid=23789): Terminating (SIGINT) 03:59:36.368883 run patchelf(pid=23789): Terminated: ok {rc=0} 03:59:36.497932 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23786): Process ended prematurely: osmo-stp_10.42.42.5(pid=23786) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23786)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:59:36.507707 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:59:36.535718 run osmo-hlr_10.42.42.2(pid=23783): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23783)] 03:59:36.585329 run osmo-hlr_10.42.42.2(pid=23783): stdout: | (launched: 2022-12-10_03:59:33.205420) 03:59:36.636350 run osmo-hlr_10.42.42.2(pid=23783): stderr: | 20221210035933404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035933404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035933404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035933404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035933405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035933405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035933417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035933425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035933425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035933425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:36.687767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Terminating (SIGTERM) 03:59:36.729328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Terminating (SIGTERM) 03:59:36.770746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23788): Terminating (SIGTERM) 03:59:36.812451 --- ParallelTerminationStrategy: PID 23782 died... 03:59:36.832332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Terminated: ok {rc=0} 03:59:36.878917 --- ParallelTerminationStrategy: PID 23785 died... 03:59:36.898611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Terminated: ok {rc=0} 03:59:36.944552 --- ParallelTerminationStrategy: PID 23788 died... 03:59:36.964002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23788): Terminated: ok {rc=0} 03:59:37.051137 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:59:38.357732 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:59:38.364188 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:59:38.398390 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:59:38.437894 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:59:38.526313 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:59:38.560280 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:59:38.599354 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:59:39.190717 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:59:39.242423 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.253512 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:59:39.324511 tst cs_paging_gprs_active.py: using LAC 25836 03:59:39.443594 tst cs_paging_gprs_active.py: using RAC 81 03:59:39.565040 tst cs_paging_gprs_active.py: using CellId 25836 03:59:39.684528 tst cs_paging_gprs_active.py: using BVCI 25837 03:59:39.796918 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.807943 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.818905 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.830219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.841456 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.852513 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.864286 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.875471 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:39.886805 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:59:40.005700 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:59:40.124937 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:59:40.345214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:40.670411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23795): Launched 03:59:40.953575 run iperf3-srv_10.42.42.10(pid=23796): Launched 03:59:41.074545 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:59:41.294252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:41.618949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23797): Launched 03:59:41.900365 run iperf3-srv_10.42.42.10(pid=23798): Launched 03:59:42.022085 tst cs_paging_gprs_active.py:38: start network... 03:59:42.242621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:42.745361 run create_hlr_db(pid=23799): Launched 03:59:42.877530 bus /gobi_6: Setting Powered False 03:59:43.940645 run create_hlr_db(pid=23799): Terminated: ok {rc=0} 03:59:44.374749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23801): Launched 03:59:44.679648 run osmo-hlr_10.42.42.2(pid=23802): Launched 03:59:44.796225 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:45.334546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23804): Launched 03:59:45.640069 run osmo-stp_10.42.42.5(pid=23805): Launched 03:59:45.757170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:46.345717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23807): Launched 03:59:46.472270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:46.749228 run patchelf(pid=23808): Launched 03:59:46.972413 run osmo-stp_10.42.42.5(pid=23805): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23805)] 03:59:47.154349 run osmo-stp_10.42.42.5(pid=23805): stdout: | (launched: 2022-12-10_03:59:45.583913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:47.290504 run osmo-stp_10.42.42.5(pid=23805): stderr: | 20221210035945756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035945756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035945757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035945757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035945758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035945758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035945758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:47.422759 run osmo-stp_10.42.42.5(pid=23805): stdout: | (launched: 2022-12-10_03:59:45.583913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:47.548426 run osmo-stp_10.42.42.5(pid=23805): stderr: | 20221210035945756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035945756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035945757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035945757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035945758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035945758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035945758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:47.697289 run patchelf(pid=23808): Terminating (SIGINT) 03:59:47.869574 run patchelf(pid=23808): Terminated: ok {rc=0} 03:59:47.993852 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23805): Process ended prematurely: osmo-stp_10.42.42.5(pid=23805) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23805)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:59:48.003714 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:59:48.032474 run osmo-hlr_10.42.42.2(pid=23802): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23802)] 03:59:48.081206 run osmo-hlr_10.42.42.2(pid=23802): stdout: | (launched: 2022-12-10_03:59:44.624118) 03:59:48.131276 run osmo-hlr_10.42.42.2(pid=23802): stderr: | 20221210035944801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035944802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035944802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035944802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035944802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035944802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035944814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035944822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035944822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035944822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:48.182315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23795): Terminating (SIGTERM) 03:59:48.222996 run iperf3-srv_10.42.42.10(pid=23796): Terminating (SIGTERM) 03:59:48.263570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23797): Terminating (SIGTERM) 03:59:48.304499 run iperf3-srv_10.42.42.10(pid=23798): Terminating (SIGTERM) 03:59:48.345204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23801): Terminating (SIGTERM) 03:59:48.385976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23804): Terminating (SIGTERM) 03:59:48.426647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23807): Terminating (SIGTERM) 03:59:48.467423 --- ParallelTerminationStrategy: PID 23795 died... 03:59:48.486585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23795): Terminated: ok {rc=0} 03:59:48.531238 --- ParallelTerminationStrategy: PID 23796 died... 03:59:48.549699 run iperf3-srv_10.42.42.10(pid=23796): Terminated {rc=256} 03:59:48.593865 --- ParallelTerminationStrategy: PID 23797 died... 03:59:48.612543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23797): Terminated: ok {rc=0} 03:59:48.656560 --- ParallelTerminationStrategy: PID 23798 died... 03:59:48.675116 run iperf3-srv_10.42.42.10(pid=23798): Terminated {rc=256} 03:59:48.719297 --- ParallelTerminationStrategy: PID 23801 died... 03:59:48.737927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23801): Terminated: ok {rc=0} 03:59:48.782137 --- ParallelTerminationStrategy: PID 23804 died... 03:59:48.800729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23804): Terminated: ok {rc=0} 03:59:48.845032 --- ParallelTerminationStrategy: PID 23807 died... 03:59:48.863636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23807): Terminated: ok {rc=0} 03:59:48.950177 bus /gobi_0: Setting Powered False 03:59:50.049549 bus /gobi_0: Setting Powered False 03:59:51.164410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:59:52.310425 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.322122 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:59:52.393568 tst iperf3.py: using LAC 25837 03:59:52.513909 tst iperf3.py: using RAC 82 03:59:52.640913 tst iperf3.py: using CellId 25837 03:59:52.767710 tst iperf3.py: using BVCI 25838 03:59:52.886800 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.898343 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.909692 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.921227 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.932363 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.943744 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.955150 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.966426 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:59:52.977854 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:59:53.093948 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:59:53.298880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:53.605254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23809): Launched 03:59:53.870247 run iperf3-srv_10.42.42.10(pid=23810): Launched 03:59:53.984782 tst iperf3.py:8: start network... 03:59:54.189440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:54.661428 run create_hlr_db(pid=23811): Launched 03:59:54.778456 bus /gobi_6: Setting Powered False 03:59:55.839545 run create_hlr_db(pid=23811): Terminated: ok {rc=0} 03:59:56.282125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23813): Launched 03:59:56.608328 run osmo-hlr_10.42.42.2(pid=23814): Launched 03:59:56.732595 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:57.295181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23816): Launched 03:59:57.621692 run osmo-stp_10.42.42.5(pid=23817): Launched 03:59:57.744727 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:58.301671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23819): Launched 03:59:58.426031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:58.700248 run patchelf(pid=23820): Launched 03:59:58.880841 run osmo-stp_10.42.42.5(pid=23817): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23817)] 03:59:59.018874 run osmo-stp_10.42.42.5(pid=23817): stdout: | (launched: 2022-12-10_03:59:57.562733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:59.159005 run osmo-stp_10.42.42.5(pid=23817): stderr: | 20221210035957754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035957755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035957755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035957755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035957758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035957758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035957758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:59.298887 run osmo-stp_10.42.42.5(pid=23817): stdout: | (launched: 2022-12-10_03:59:57.562733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:59.432643 run osmo-stp_10.42.42.5(pid=23817): stderr: | 20221210035957754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210035957755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210035957755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210035957755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210035957758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210035957758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210035957758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:59.590434 run patchelf(pid=23820): Terminating (SIGINT) 03:59:59.772479 run patchelf(pid=23820): Terminated: ok {rc=0} 03:59:59.904039 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23817): Process ended prematurely: osmo-stp_10.42.42.5(pid=23817) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23817)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 03:59:59.914533 tst iperf3.py:8: Test FAILED (7.6 sec) 03:59:59.943466 run osmo-hlr_10.42.42.2(pid=23814): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23814)] 03:59:59.993345 run osmo-hlr_10.42.42.2(pid=23814): stdout: | (launched: 2022-12-10_03:59:56.549293) 04:00:00.044831 run osmo-hlr_10.42.42.2(pid=23814): stderr: | 20221210035956751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210035956751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210035956751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210035956751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210035956751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210035956751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210035956764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210035956774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210035956774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210035956774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:00.097195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23809): Terminating (SIGTERM) 04:00:00.139276 run iperf3-srv_10.42.42.10(pid=23810): Terminating (SIGTERM) 04:00:00.181580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23813): Terminating (SIGTERM) 04:00:00.223930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23816): Terminating (SIGTERM) 04:00:00.266396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23819): Terminating (SIGTERM) 04:00:00.308666 --- ParallelTerminationStrategy: PID 23809 died... 04:00:00.328715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23809): Terminated: ok {rc=0} 04:00:00.375996 --- ParallelTerminationStrategy: PID 23810 died... 04:00:00.395700 run iperf3-srv_10.42.42.10(pid=23810): Terminated {rc=256} 04:00:00.442476 --- ParallelTerminationStrategy: PID 23813 died... 04:00:00.462297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23813): Terminated: ok {rc=0} 04:00:00.509031 --- ParallelTerminationStrategy: PID 23816 died... 04:00:00.528796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23816): Terminated: ok {rc=0} 04:00:00.575508 --- ParallelTerminationStrategy: PID 23819 died... 04:00:00.595285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23819): Terminated: ok {rc=0} 04:00:00.682917 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:00:01.853752 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:01.866775 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:01.943461 tst iperf3m4.py: using LAC 25838 04:00:02.078979 tst iperf3m4.py: using RAC 83 04:00:02.208177 tst iperf3m4.py: using CellId 25838 04:00:02.337219 tst iperf3m4.py: using BVCI 25839 04:00:02.455525 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.467168 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.478547 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.490071 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.501610 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.513050 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.524600 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.536031 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:02.547827 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:02.666895 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:02.789531 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:02.909539 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:03.030631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:00:03.250729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:03.576757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23824): Launched 04:00:03.858719 run iperf3-srv_10.42.42.10(pid=23825): Launched 04:00:03.980268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:00:04.200883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:04.527759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23826): Launched 04:00:04.810006 run iperf3-srv_10.42.42.10(pid=23827): Launched 04:00:04.930845 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:00:05.150152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:05.475380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23828): Launched 04:00:05.756861 run iperf3-srv_10.42.42.10(pid=23829): Launched 04:00:05.872812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:00:06.078561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:06.385448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23830): Launched 04:00:06.650720 run iperf3-srv_10.42.42.10(pid=23831): Launched 04:00:06.764441 tst iperf3m4.py:8: start network... 04:00:06.968222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:07.442527 run create_hlr_db(pid=23832): Launched 04:00:07.558238 bus /gobi_6: Setting Powered False 04:00:08.621713 run create_hlr_db(pid=23832): Terminated: ok {rc=0} 04:00:09.055981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23834): Launched 04:00:09.362427 run osmo-hlr_10.42.42.2(pid=23835): Launched 04:00:09.478456 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:10.016026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23837): Launched 04:00:10.320511 run osmo-stp_10.42.42.5(pid=23838): Launched 04:00:10.435631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:10.960066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23840): Launched 04:00:11.076474 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:11.333990 run patchelf(pid=23841): Launched 04:00:11.502917 run osmo-stp_10.42.42.5(pid=23838): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23838)] 04:00:11.632055 run osmo-stp_10.42.42.5(pid=23838): stdout: | (launched: 2022-12-10_04:00:10.264207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:11.762862 run osmo-stp_10.42.42.5(pid=23838): stderr: | 20221210040010434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040010435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040010435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040010435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040010437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040010438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040010438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:11.893634 run osmo-stp_10.42.42.5(pid=23838): stdout: | (launched: 2022-12-10_04:00:10.264207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:12.018345 run osmo-stp_10.42.42.5(pid=23838): stderr: | 20221210040010434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040010435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040010435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040010435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040010437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040010438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040010438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:12.166253 run patchelf(pid=23841): Terminating (SIGINT) 04:00:12.336938 run patchelf(pid=23841): Terminated: ok {rc=0} 04:00:12.460510 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23838): Process ended prematurely: osmo-stp_10.42.42.5(pid=23838) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23838)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:00:12.470236 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:00:12.498268 run osmo-hlr_10.42.42.2(pid=23835): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23835)] 04:00:12.545888 run osmo-hlr_10.42.42.2(pid=23835): stdout: | (launched: 2022-12-10_04:00:09.306339) 04:00:12.595387 run osmo-hlr_10.42.42.2(pid=23835): stderr: | 20221210040009480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040009480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040009480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040009480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040009480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040009480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040009493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040009501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040009502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040009502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:12.645315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23824): Terminating (SIGTERM) 04:00:12.685218 run iperf3-srv_10.42.42.10(pid=23825): Terminating (SIGTERM) 04:00:12.725228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23826): Terminating (SIGTERM) 04:00:12.764794 run iperf3-srv_10.42.42.10(pid=23827): Terminating (SIGTERM) 04:00:12.804249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23828): Terminating (SIGTERM) 04:00:12.843942 run iperf3-srv_10.42.42.10(pid=23829): Terminating (SIGTERM) 04:00:12.883466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23830): Terminating (SIGTERM) 04:00:12.923101 run iperf3-srv_10.42.42.10(pid=23831): Terminating (SIGTERM) 04:00:12.962587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23834): Terminating (SIGTERM) 04:00:13.002207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23837): Terminating (SIGTERM) 04:00:13.041689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23840): Terminating (SIGTERM) 04:00:13.081495 --- ParallelTerminationStrategy: PID 23824 died... 04:00:13.100893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23824): Terminated: ok {rc=0} 04:00:13.144928 --- ParallelTerminationStrategy: PID 23825 died... 04:00:13.163545 run iperf3-srv_10.42.42.10(pid=23825): Terminated {rc=256} 04:00:13.208096 --- ParallelTerminationStrategy: PID 23826 died... 04:00:13.226629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23826): Terminated: ok {rc=0} 04:00:13.270597 --- ParallelTerminationStrategy: PID 23827 died... 04:00:13.288994 run iperf3-srv_10.42.42.10(pid=23827): Terminated {rc=256} 04:00:13.332737 --- ParallelTerminationStrategy: PID 23828 died... 04:00:13.351231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23828): Terminated: ok {rc=0} 04:00:13.395183 --- ParallelTerminationStrategy: PID 23829 died... 04:00:13.413597 run iperf3-srv_10.42.42.10(pid=23829): Terminated {rc=256} 04:00:13.457452 --- ParallelTerminationStrategy: PID 23830 died... 04:00:13.475961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23830): Terminated: ok {rc=0} 04:00:13.519937 --- ParallelTerminationStrategy: PID 23831 died... 04:00:13.538415 run iperf3-srv_10.42.42.10(pid=23831): Terminated {rc=256} 04:00:13.582352 --- ParallelTerminationStrategy: PID 23834 died... 04:00:13.600683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23834): Terminated: ok {rc=0} 04:00:13.644632 --- ParallelTerminationStrategy: PID 23837 died... 04:00:13.663225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23837): Terminated: ok {rc=0} 04:00:13.707161 --- ParallelTerminationStrategy: PID 23840 died... 04:00:13.725841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23840): Terminated: ok {rc=0} 04:00:13.808724 bus /gobi_4: Setting Powered False 04:00:14.905633 bus /gobi_4: Setting Powered False 04:00:16.020685 bus /gobi_1: Setting Powered False 04:00:17.120425 bus /gobi_1: Setting Powered False 04:00:18.237730 bus /gobi_0: Setting Powered False 04:00:19.335406 bus /gobi_0: Setting Powered False 04:00:20.451301 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:00:21.554190 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:21.566229 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:21.639646 tst ping.py: using LAC 25839 04:00:21.765279 tst ping.py: using RAC 84 04:00:21.889941 tst ping.py: using CellId 25839 04:00:22.018544 tst ping.py: using BVCI 25840 04:00:22.136381 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:22.148066 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:22.159425 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:22.171264 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:22.182991 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:22.194677 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:22.206696 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:22.218646 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:22.337567 tst ping.py:19: start network... 04:00:22.552524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:23.043721 run create_hlr_db(pid=23842): Launched 04:00:23.172936 bus /gobi_6: Setting Powered False 04:00:24.236213 run create_hlr_db(pid=23842): Terminated: ok {rc=0} 04:00:24.665147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23844): Launched 04:00:24.965832 run osmo-hlr_10.42.42.2(pid=23845): Launched 04:00:25.080231 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:25.615257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23847): Launched 04:00:25.913989 run osmo-stp_10.42.42.5(pid=23848): Launched 04:00:26.027448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:26.542502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23850): Launched 04:00:26.657174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:26.909137 run patchelf(pid=23851): Launched 04:00:27.075007 run osmo-stp_10.42.42.5(pid=23848): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23848)] 04:00:27.201743 run osmo-stp_10.42.42.5(pid=23848): stdout: | (launched: 2022-12-10_04:00:25.859026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:27.330359 run osmo-stp_10.42.42.5(pid=23848): stderr: | 20221210040026031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040026031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040026031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040026032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040026032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040026032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040026032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:27.458421 run osmo-stp_10.42.42.5(pid=23848): stdout: | (launched: 2022-12-10_04:00:25.859026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:27.580596 run osmo-stp_10.42.42.5(pid=23848): stderr: | 20221210040026031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040026031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040026031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040026032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040026032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040026032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040026032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:27.725738 run patchelf(pid=23851): Terminating (SIGINT) 04:00:27.893274 run patchelf(pid=23851): Terminated: ok {rc=0} 04:00:28.014243 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23848): Process ended prematurely: osmo-stp_10.42.42.5(pid=23848) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23848)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 04:00:28.023257 tst ping.py:22: Test FAILED (6.5 sec) 04:00:28.050201 run osmo-hlr_10.42.42.2(pid=23845): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23845)] 04:00:28.097562 run osmo-hlr_10.42.42.2(pid=23845): stdout: | (launched: 2022-12-10_04:00:24.910820) 04:00:28.146667 run osmo-hlr_10.42.42.2(pid=23845): stderr: | 20221210040025084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040025084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040025084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040025084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040025084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040025084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040025096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040025105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040025105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040025105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:28.196235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23844): Terminating (SIGTERM) 04:00:28.235768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23847): Terminating (SIGTERM) 04:00:28.275295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23850): Terminating (SIGTERM) 04:00:28.315023 --- ParallelTerminationStrategy: PID 23844 died... 04:00:28.333948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23844): Terminated: ok {rc=0} 04:00:28.378013 --- ParallelTerminationStrategy: PID 23847 died... 04:00:28.396466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23847): Terminated: ok {rc=0} 04:00:28.441352 --- ParallelTerminationStrategy: PID 23850 died... 04:00:28.459860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23850): Terminated: ok {rc=0} 04:00:28.546116 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:00:29.633454 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:29.645590 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:29.722422 tst ping_idle_ping.py: using LAC 25840 04:00:29.841171 tst ping_idle_ping.py: using RAC 85 04:00:29.956283 tst ping_idle_ping.py: using CellId 25840 04:00:30.072868 tst ping_idle_ping.py: using BVCI 25841 04:00:30.180878 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.191779 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.202417 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.213378 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.224113 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.234908 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.245856 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.256608 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:30.375133 tst ping_idle_ping.py:24: start network... 04:00:30.592319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:31.124435 run create_hlr_db(pid=23852): Launched 04:00:31.289658 bus /gobi_6: Setting Powered False 04:00:32.351948 run create_hlr_db(pid=23852): Terminated: ok {rc=0} 04:00:32.782606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23854): Launched 04:00:33.082343 run osmo-hlr_10.42.42.2(pid=23855): Launched 04:00:33.196041 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:33.725028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23857): Launched 04:00:34.024528 run osmo-stp_10.42.42.5(pid=23858): Launched 04:00:34.138910 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:34.655734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23860): Launched 04:00:34.770740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:35.023721 run patchelf(pid=23861): Launched 04:00:35.190287 run osmo-stp_10.42.42.5(pid=23858): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23858)] 04:00:35.317642 run osmo-stp_10.42.42.5(pid=23858): stdout: | (launched: 2022-12-10_04:00:33.969599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:35.447133 run osmo-stp_10.42.42.5(pid=23858): stderr: | 20221210040034140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040034140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040034141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040034141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040034142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040034142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040034142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:35.575705 run osmo-stp_10.42.42.5(pid=23858): stdout: | (launched: 2022-12-10_04:00:33.969599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:35.698286 run osmo-stp_10.42.42.5(pid=23858): stderr: | 20221210040034140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040034140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040034141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040034141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040034142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040034142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040034142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:35.843800 run patchelf(pid=23861): Terminating (SIGINT) 04:00:36.011457 run patchelf(pid=23861): Terminated: ok {rc=0} 04:00:36.132699 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23858): Process ended prematurely: osmo-stp_10.42.42.5(pid=23858) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23858)] [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:00:36.141853 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:00:36.169242 run osmo-hlr_10.42.42.2(pid=23855): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23855)] 04:00:36.216698 run osmo-hlr_10.42.42.2(pid=23855): stdout: | (launched: 2022-12-10_04:00:33.027155) 04:00:36.265939 run osmo-hlr_10.42.42.2(pid=23855): stderr: | 20221210040033203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040033203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040033203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040033203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040033203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040033203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040033215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040033226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040033226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040033226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:36.315620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23854): Terminating (SIGTERM) 04:00:36.355463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23857): Terminating (SIGTERM) 04:00:36.395183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23860): Terminating (SIGTERM) 04:00:36.435060 --- ParallelTerminationStrategy: PID 23854 died... 04:00:36.453947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23854): Terminated: ok {rc=0} 04:00:36.498363 --- ParallelTerminationStrategy: PID 23857 died... 04:00:36.516811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23857): Terminated: ok {rc=0} 04:00:36.561188 --- ParallelTerminationStrategy: PID 23860 died... 04:00:36.579730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23860): Terminated: ok {rc=0} 04:00:36.665935 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:00:37.967926 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:00:37.974313 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:00:38.008216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:00:38.046881 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:00:38.137759 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:00:38.171400 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:00:38.210112 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:00:38.803385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:00:38.853256 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:38.864665 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:00:38.916183 tst cs_paging_gprs_active.py: using LAC 25841 04:00:39.036247 tst cs_paging_gprs_active.py: using RAC 86 04:00:39.154397 tst cs_paging_gprs_active.py: using CellId 25841 04:00:39.274123 tst cs_paging_gprs_active.py: using BVCI 25842 04:00:39.387282 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.398770 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.410126 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.421635 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.433312 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.444940 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.456625 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.468109 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:39.479883 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:00:39.601157 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:00:39.720384 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:00:39.940412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:40.266559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23865): Launched 04:00:40.550429 run iperf3-srv_10.42.42.10(pid=23866): Launched 04:00:40.673001 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:00:40.892629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:41.219439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23867): Launched 04:00:41.503912 run iperf3-srv_10.42.42.10(pid=23868): Launched 04:00:41.625824 tst cs_paging_gprs_active.py:38: start network... 04:00:41.846042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:42.350364 run create_hlr_db(pid=23869): Launched 04:00:42.483348 bus /gobi_6: Setting Powered False 04:00:43.547631 run create_hlr_db(pid=23869): Terminated: ok {rc=0} 04:00:43.983750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23871): Launched 04:00:44.289083 run osmo-hlr_10.42.42.2(pid=23872): Launched 04:00:44.406031 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:44.967140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23874): Launched 04:00:45.291331 run osmo-stp_10.42.42.5(pid=23875): Launched 04:00:45.415121 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:45.999257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23877): Launched 04:00:46.159486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:46.474176 run patchelf(pid=23878): Launched 04:00:46.664594 run osmo-stp_10.42.42.5(pid=23875): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23875)] 04:00:46.799644 run osmo-stp_10.42.42.5(pid=23875): stdout: | (launched: 2022-12-10_04:00:45.232110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:46.935010 run osmo-stp_10.42.42.5(pid=23875): stderr: | 20221210040045427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040045427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040045428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040045428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040045428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040045428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040045429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:47.071355 run osmo-stp_10.42.42.5(pid=23875): stdout: | (launched: 2022-12-10_04:00:45.232110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:47.201301 run osmo-stp_10.42.42.5(pid=23875): stderr: | 20221210040045427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040045427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040045428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040045428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040045428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040045428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040045429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:47.352247 run patchelf(pid=23878): Terminating (SIGINT) 04:00:47.524516 run patchelf(pid=23878): Terminated: ok {rc=0} 04:00:47.648240 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23875): Process ended prematurely: osmo-stp_10.42.42.5(pid=23875) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23875)] [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:00:47.658271 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:00:47.686493 run osmo-hlr_10.42.42.2(pid=23872): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23872)] 04:00:47.734633 run osmo-hlr_10.42.42.2(pid=23872): stdout: | (launched: 2022-12-10_04:00:44.233342) 04:00:47.784425 run osmo-hlr_10.42.42.2(pid=23872): stderr: | 20221210040044412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040044412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040044412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040044412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040044412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040044412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040044424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040044432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040044433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040044433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:47.834767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23865): Terminating (SIGTERM) 04:00:47.874924 run iperf3-srv_10.42.42.10(pid=23866): Terminating (SIGTERM) 04:00:47.915048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23867): Terminating (SIGTERM) 04:00:47.955073 run iperf3-srv_10.42.42.10(pid=23868): Terminating (SIGTERM) 04:00:47.994916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23871): Terminating (SIGTERM) 04:00:48.035021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23874): Terminating (SIGTERM) 04:00:48.074830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23877): Terminating (SIGTERM) 04:00:48.114898 --- ParallelTerminationStrategy: PID 23865 died... 04:00:48.133762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23865): Terminated: ok {rc=0} 04:00:48.178246 --- ParallelTerminationStrategy: PID 23866 died... 04:00:48.196674 run iperf3-srv_10.42.42.10(pid=23866): Terminated {rc=256} 04:00:48.240794 --- ParallelTerminationStrategy: PID 23867 died... 04:00:48.259439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23867): Terminated: ok {rc=0} 04:00:48.303547 --- ParallelTerminationStrategy: PID 23868 died... 04:00:48.322057 run iperf3-srv_10.42.42.10(pid=23868): Terminated {rc=256} 04:00:48.366186 --- ParallelTerminationStrategy: PID 23871 died... 04:00:48.384771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23871): Terminated: ok {rc=0} 04:00:48.429458 --- ParallelTerminationStrategy: PID 23874 died... 04:00:48.448128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23874): Terminated: ok {rc=0} 04:00:48.492358 --- ParallelTerminationStrategy: PID 23877 died... 04:00:48.511118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23877): Terminated: ok {rc=0} 04:00:48.596532 bus /gobi_0: Setting Powered False 04:00:49.695476 bus /gobi_0: Setting Powered False 04:00:50.806472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:00:51.955421 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:51.967720 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:00:52.024538 tst iperf3.py: using LAC 25842 04:00:52.153045 tst iperf3.py: using RAC 87 04:00:52.279576 tst iperf3.py: using CellId 25842 04:00:52.407207 tst iperf3.py: using BVCI 25843 04:00:52.525101 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.536822 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.548499 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.560582 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.572488 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.584020 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.595885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.607352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:00:52.619108 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:00:52.736713 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:00:52.956937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:53.283042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23879): Launched 04:00:53.566515 run iperf3-srv_10.42.42.10(pid=23880): Launched 04:00:53.687802 tst iperf3.py:8: start network... 04:00:53.907431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:54.410000 run create_hlr_db(pid=23881): Launched 04:00:54.540524 bus /gobi_6: Setting Powered False 04:00:55.605185 run create_hlr_db(pid=23881): Terminated: ok {rc=0} 04:00:56.037569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23883): Launched 04:00:56.342627 run osmo-hlr_10.42.42.2(pid=23884): Launched 04:00:56.459563 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:56.996337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23886): Launched 04:00:57.321848 run osmo-stp_10.42.42.5(pid=23887): Launched 04:00:57.446423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:58.006173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23889): Launched 04:00:58.130253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:58.404793 run patchelf(pid=23890): Launched 04:00:58.584634 run osmo-stp_10.42.42.5(pid=23887): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23887)] 04:00:58.721753 run osmo-stp_10.42.42.5(pid=23887): stdout: | (launched: 2022-12-10_04:00:57.262882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:58.860399 run osmo-stp_10.42.42.5(pid=23887): stderr: | 20221210040057458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040057458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040057458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040057458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040057459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040057459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040057459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:58.999838 run osmo-stp_10.42.42.5(pid=23887): stdout: | (launched: 2022-12-10_04:00:57.262882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:59.132268 run osmo-stp_10.42.42.5(pid=23887): stderr: | 20221210040057458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040057458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040057458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040057458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040057459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040057459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040057459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:59.289871 run patchelf(pid=23890): Terminating (SIGINT) 04:00:59.472467 run patchelf(pid=23890): Terminated: ok {rc=0} 04:00:59.604182 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23887): Process ended prematurely: osmo-stp_10.42.42.5(pid=23887) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23887)] [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:00:59.614660 tst iperf3.py:8: Test FAILED (7.7 sec) 04:00:59.643234 run osmo-hlr_10.42.42.2(pid=23884): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23884)] 04:00:59.695231 run osmo-hlr_10.42.42.2(pid=23884): stdout: | (launched: 2022-12-10_04:00:56.286645) 04:00:59.745151 run osmo-hlr_10.42.42.2(pid=23884): stderr: | 20221210040056464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040056464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040056464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040056464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040056464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040056464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040056476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040056486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040056486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040056486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:59.795409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23879): Terminating (SIGTERM) 04:00:59.835796 run iperf3-srv_10.42.42.10(pid=23880): Terminating (SIGTERM) 04:00:59.876167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23883): Terminating (SIGTERM) 04:00:59.916413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23886): Terminating (SIGTERM) 04:00:59.956917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23889): Terminating (SIGTERM) 04:00:59.997994 --- ParallelTerminationStrategy: PID 23879 died... 04:01:00.016669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23879): Terminated: ok {rc=0} 04:01:00.062030 --- ParallelTerminationStrategy: PID 23880 died... 04:01:00.080332 run iperf3-srv_10.42.42.10(pid=23880): Terminated {rc=256} 04:01:00.125665 --- ParallelTerminationStrategy: PID 23883 died... 04:01:00.144031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23883): Terminated: ok {rc=0} 04:01:00.189154 --- ParallelTerminationStrategy: PID 23886 died... 04:01:00.207740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23886): Terminated: ok {rc=0} 04:01:00.252013 --- ParallelTerminationStrategy: PID 23889 died... 04:01:00.270518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23889): Terminated: ok {rc=0} 04:01:00.356029 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:01:01.503234 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:01.516204 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:01.573296 tst iperf3m4.py: using LAC 25843 04:01:01.706670 tst iperf3m4.py: using RAC 88 04:01:01.874152 tst iperf3m4.py: using CellId 25843 04:01:02.039899 tst iperf3m4.py: using BVCI 25844 04:01:02.212810 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.225356 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.237479 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.249424 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.261856 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.273799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.286235 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.298332 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:02.313031 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:02.432686 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:02.554904 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:02.676770 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:02.793924 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:01:02.999289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:03.305271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23891): Launched 04:01:03.571128 run iperf3-srv_10.42.42.10(pid=23892): Launched 04:01:03.685861 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:01:03.890494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:04.195630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23893): Launched 04:01:04.462266 run iperf3-srv_10.42.42.10(pid=23894): Launched 04:01:04.576633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:01:04.781952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:05.087311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Launched 04:01:05.352775 run iperf3-srv_10.42.42.10(pid=23896): Launched 04:01:05.466951 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:01:05.672050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:05.977758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Launched 04:01:06.242992 run iperf3-srv_10.42.42.10(pid=23898): Launched 04:01:06.357070 tst iperf3m4.py:8: start network... 04:01:06.561548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:07.031826 run create_hlr_db(pid=23899): Launched 04:01:07.148667 bus /gobi_6: Setting Powered False 04:01:08.209867 run create_hlr_db(pid=23899): Terminated: ok {rc=0} 04:01:08.632940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Launched 04:01:08.937963 run osmo-hlr_10.42.42.2(pid=23902): Launched 04:01:09.054263 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:09.598509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Launched 04:01:09.903615 run osmo-stp_10.42.42.5(pid=23905): Launched 04:01:10.019990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:10.544709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Launched 04:01:10.661891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:10.919034 run patchelf(pid=23908): Launched 04:01:11.088321 run osmo-stp_10.42.42.5(pid=23905): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] 04:01:11.217487 run osmo-stp_10.42.42.5(pid=23905): stdout: | (launched: 2022-12-10_04:01:09.847989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:11.347775 run osmo-stp_10.42.42.5(pid=23905): stderr: | 20221210040110019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040110019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040110019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040110019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040110020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040110020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040110020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:11.478534 run osmo-stp_10.42.42.5(pid=23905): stdout: | (launched: 2022-12-10_04:01:09.847989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:11.603234 run osmo-stp_10.42.42.5(pid=23905): stderr: | 20221210040110019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040110019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040110019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040110019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040110020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040110020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040110020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:11.751304 run patchelf(pid=23908): Terminating (SIGINT) 04:01:11.922030 run patchelf(pid=23908): Terminated: ok {rc=0} 04:01:12.045471 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23905): Process ended prematurely: osmo-stp_10.42.42.5(pid=23905) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:01:12.055198 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:01:12.083119 run osmo-hlr_10.42.42.2(pid=23902): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23902)] 04:01:12.130915 run osmo-hlr_10.42.42.2(pid=23902): stdout: | (launched: 2022-12-10_04:01:08.881652) 04:01:12.180104 run osmo-hlr_10.42.42.2(pid=23902): stderr: | 20221210040109060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040109060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040109060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040109060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040109060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040109060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040109071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040109080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040109080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040109080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:12.229945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23891): Terminating (SIGTERM) 04:01:12.269819 run iperf3-srv_10.42.42.10(pid=23892): Terminating (SIGTERM) 04:01:12.309679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23893): Terminating (SIGTERM) 04:01:12.349588 run iperf3-srv_10.42.42.10(pid=23894): Terminating (SIGTERM) 04:01:12.389322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Terminating (SIGTERM) 04:01:12.429718 run iperf3-srv_10.42.42.10(pid=23896): Terminating (SIGTERM) 04:01:12.469596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Terminating (SIGTERM) 04:01:12.509589 run iperf3-srv_10.42.42.10(pid=23898): Terminating (SIGTERM) 04:01:12.549300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Terminating (SIGTERM) 04:01:12.589679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Terminating (SIGTERM) 04:01:12.629238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Terminating (SIGTERM) 04:01:12.669073 --- ParallelTerminationStrategy: PID 23891 died... 04:01:12.688011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23891): Terminated: ok {rc=0} 04:01:12.733244 --- ParallelTerminationStrategy: PID 23892 died... 04:01:12.752117 run iperf3-srv_10.42.42.10(pid=23892): Terminated {rc=256} 04:01:12.796247 --- ParallelTerminationStrategy: PID 23893 died... 04:01:12.814975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23893): Terminated: ok {rc=0} 04:01:12.859152 --- ParallelTerminationStrategy: PID 23894 died... 04:01:12.877705 run iperf3-srv_10.42.42.10(pid=23894): Terminated {rc=256} 04:01:12.922259 --- ParallelTerminationStrategy: PID 23895 died... 04:01:12.940832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Terminated: ok {rc=0} 04:01:12.984870 --- ParallelTerminationStrategy: PID 23896 died... 04:01:13.003723 run iperf3-srv_10.42.42.10(pid=23896): Terminated {rc=256} 04:01:13.047473 --- ParallelTerminationStrategy: PID 23897 died... 04:01:13.065838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Terminated: ok {rc=0} 04:01:13.110265 --- ParallelTerminationStrategy: PID 23898 died... 04:01:13.128713 run iperf3-srv_10.42.42.10(pid=23898): Terminated {rc=256} 04:01:13.172798 --- ParallelTerminationStrategy: PID 23901 died... 04:01:13.191720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23901): Terminated: ok {rc=0} 04:01:13.235784 --- ParallelTerminationStrategy: PID 23904 died... 04:01:13.254374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23904): Terminated: ok {rc=0} 04:01:13.298443 --- ParallelTerminationStrategy: PID 23907 died... 04:01:13.316903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23907): Terminated: ok {rc=0} 04:01:13.399827 bus /gobi_4: Setting Powered False 04:01:14.496854 bus /gobi_4: Setting Powered False 04:01:15.612120 bus /gobi_1: Setting Powered False 04:01:16.713748 bus /gobi_1: Setting Powered False 04:01:17.829454 bus /gobi_0: Setting Powered False 04:01:18.927244 bus /gobi_0: Setting Powered False 04:01:20.043056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:01:21.146343 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.158314 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:21.211018 tst ping.py: using LAC 25844 04:01:21.328538 tst ping.py: using RAC 89 04:01:21.444678 tst ping.py: using CellId 25844 04:01:21.562359 tst ping.py: using BVCI 25845 04:01:21.672492 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.683840 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.694983 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.706551 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.717837 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.729236 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.740693 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:21.751998 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:21.870309 tst ping.py:19: start network... 04:01:22.086795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:22.583188 run create_hlr_db(pid=23909): Launched 04:01:22.713317 bus /gobi_6: Setting Powered False 04:01:23.777077 run create_hlr_db(pid=23909): Terminated: ok {rc=0} 04:01:24.206284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23911): Launched 04:01:24.506282 run osmo-hlr_10.42.42.2(pid=23912): Launched 04:01:24.621193 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:25.151880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23914): Launched 04:01:25.450242 run osmo-stp_10.42.42.5(pid=23915): Launched 04:01:25.564049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:26.081201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23917): Launched 04:01:26.195648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:26.449380 run patchelf(pid=23918): Launched 04:01:26.615812 run osmo-stp_10.42.42.5(pid=23915): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23915)] 04:01:26.742680 run osmo-stp_10.42.42.5(pid=23915): stdout: | (launched: 2022-12-10_04:01:25.395257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:26.871198 run osmo-stp_10.42.42.5(pid=23915): stderr: | 20221210040125564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040125564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040125564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040125565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040125567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040125567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040125567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:26.999514 run osmo-stp_10.42.42.5(pid=23915): stdout: | (launched: 2022-12-10_04:01:25.395257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:27.122590 run osmo-stp_10.42.42.5(pid=23915): stderr: | 20221210040125564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040125564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040125564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040125565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040125567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040125567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040125567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:27.267993 run patchelf(pid=23918): Terminating (SIGINT) 04:01:27.435392 run patchelf(pid=23918): Terminated: ok {rc=0} 04:01:27.556680 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23915): Process ended prematurely: osmo-stp_10.42.42.5(pid=23915) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23915)] [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:01:27.565788 tst ping.py:22: Test FAILED (6.4 sec) 04:01:27.592790 run osmo-hlr_10.42.42.2(pid=23912): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23912)] 04:01:27.640680 run osmo-hlr_10.42.42.2(pid=23912): stdout: | (launched: 2022-12-10_04:01:24.451117) 04:01:27.690152 run osmo-hlr_10.42.42.2(pid=23912): stderr: | 20221210040124631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040124631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040124631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040124631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040124631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040124631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040124643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040124654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040124654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040124654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:27.739884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23911): Terminating (SIGTERM) 04:01:27.780061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23914): Terminating (SIGTERM) 04:01:27.820166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23917): Terminating (SIGTERM) 04:01:27.860305 --- ParallelTerminationStrategy: PID 23911 died... 04:01:27.879458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23911): Terminated: ok {rc=0} 04:01:27.923999 --- ParallelTerminationStrategy: PID 23914 died... 04:01:27.942687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23914): Terminated: ok {rc=0} 04:01:27.987448 --- ParallelTerminationStrategy: PID 23917 died... 04:01:28.006266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23917): Terminated: ok {rc=0} 04:01:28.091702 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:01:29.180523 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.193244 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:29.247279 tst ping_idle_ping.py: using LAC 25845 04:01:29.367155 tst ping_idle_ping.py: using RAC 90 04:01:29.485822 tst ping_idle_ping.py: using CellId 25845 04:01:29.609563 tst ping_idle_ping.py: using BVCI 25846 04:01:29.719993 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.731319 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.742412 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.753910 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.765267 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.776776 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.788514 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:29.799988 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:29.918227 tst ping_idle_ping.py:24: start network... 04:01:30.136099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:30.634600 run create_hlr_db(pid=23919): Launched 04:01:30.763947 bus /gobi_6: Setting Powered False 04:01:31.833640 run create_hlr_db(pid=23919): Terminated: ok {rc=0} 04:01:32.278797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23921): Launched 04:01:32.581289 run osmo-hlr_10.42.42.2(pid=23922): Launched 04:01:32.696384 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:33.229283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23924): Launched 04:01:33.529687 run osmo-stp_10.42.42.5(pid=23925): Launched 04:01:33.644028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:34.163145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23927): Launched 04:01:34.277968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:34.531768 run patchelf(pid=23928): Launched 04:01:34.699480 run osmo-stp_10.42.42.5(pid=23925): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23925)] 04:01:34.827214 run osmo-stp_10.42.42.5(pid=23925): stdout: | (launched: 2022-12-10_04:01:33.474610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:34.956120 run osmo-stp_10.42.42.5(pid=23925): stderr: | 20221210040133645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040133645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040133645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040133645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040133646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040133646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040133646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:35.085887 run osmo-stp_10.42.42.5(pid=23925): stdout: | (launched: 2022-12-10_04:01:33.474610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:35.209812 run osmo-stp_10.42.42.5(pid=23925): stderr: | 20221210040133645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040133645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040133645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040133645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040133646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040133646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040133646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:35.355430 run patchelf(pid=23928): Terminating (SIGINT) 04:01:35.524051 run patchelf(pid=23928): Terminated: ok {rc=0} 04:01:35.645692 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23925): Process ended prematurely: osmo-stp_10.42.42.5(pid=23925) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23925)] [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:01:35.654789 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:01:35.682196 run osmo-hlr_10.42.42.2(pid=23922): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23922)] 04:01:35.730880 run osmo-hlr_10.42.42.2(pid=23922): stdout: | (launched: 2022-12-10_04:01:32.525721) 04:01:35.780894 run osmo-hlr_10.42.42.2(pid=23922): stderr: | 20221210040132699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040132699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040132699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040132699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040132700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040132700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040132711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040132720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040132720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040132720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:35.831512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23921): Terminating (SIGTERM) 04:01:35.871897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23924): Terminating (SIGTERM) 04:01:35.912552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23927): Terminating (SIGTERM) 04:01:35.953523 --- ParallelTerminationStrategy: PID 23921 died... 04:01:35.972647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23921): Terminated: ok {rc=0} 04:01:36.017849 --- ParallelTerminationStrategy: PID 23924 died... 04:01:36.036709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23924): Terminated: ok {rc=0} 04:01:36.081456 --- ParallelTerminationStrategy: PID 23927 died... 04:01:36.100309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23927): Terminated: ok {rc=0} 04:01:36.187059 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:01:37.496342 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:01:37.502985 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:01:37.537872 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:01:37.572680 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:01:37.625503 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:01:37.658869 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:01:37.693583 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:01:38.250521 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:01:38.255690 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.266914 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:01:38.336911 tst switch_tch_pdch.py: using LAC 25846 04:01:38.456727 tst switch_tch_pdch.py: using RAC 91 04:01:38.583017 tst switch_tch_pdch.py: using CellId 25846 04:01:38.702365 tst switch_tch_pdch.py: using BVCI 25847 04:01:38.819816 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.832169 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.844386 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.857680 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.869357 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.881497 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.894404 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:01:38.906680 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:01:39.021619 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:01:39.138092 tst switch_tch_pdch.py:51: start network... 04:01:39.352044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:39.846388 run create_hlr_db(pid=23932): Launched 04:01:39.976250 bus /gobi_6: Setting Powered False 04:01:41.040518 run create_hlr_db(pid=23932): Terminated: ok {rc=0} 04:01:41.484205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23934): Launched 04:01:41.803151 run osmo-hlr_10.42.42.2(pid=23935): Launched 04:01:41.925691 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:42.475071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23937): Launched 04:01:42.794126 run osmo-stp_10.42.42.5(pid=23938): Launched 04:01:42.915052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:43.466060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23940): Launched 04:01:43.587561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:43.861345 run patchelf(pid=23955): Launched 04:01:44.038026 run osmo-stp_10.42.42.5(pid=23938): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23938)] 04:01:44.172918 run osmo-stp_10.42.42.5(pid=23938): stdout: | (launched: 2022-12-10_04:01:42.735373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:44.309425 run osmo-stp_10.42.42.5(pid=23938): stderr: | 20221210040142926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040142926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040142926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040142927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040142929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040142929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040142929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:44.446181 run osmo-stp_10.42.42.5(pid=23938): stdout: | (launched: 2022-12-10_04:01:42.735373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:44.576889 run osmo-stp_10.42.42.5(pid=23938): stderr: | 20221210040142926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040142926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040142926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040142927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040142929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040142929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040142929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:44.731377 run patchelf(pid=23955): Terminating (SIGINT) 04:01:44.909235 run patchelf(pid=23955): Terminated: ok {rc=0} 04:01:45.037782 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23938): Process ended prematurely: osmo-stp_10.42.42.5(pid=23938) [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23938)] [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:01:45.047435 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 04:01:45.075588 run osmo-hlr_10.42.42.2(pid=23935): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23935)] 04:01:45.125437 run osmo-hlr_10.42.42.2(pid=23935): stdout: | (launched: 2022-12-10_04:01:41.744731) 04:01:45.177097 run osmo-hlr_10.42.42.2(pid=23935): stderr: | 20221210040141944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040141944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040141944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040141944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040141944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040141944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040141976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040141986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040141986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040141986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:45.228867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23934): Terminating (SIGTERM) 04:01:45.270693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23937): Terminating (SIGTERM) 04:01:45.312482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23940): Terminating (SIGTERM) 04:01:45.354825 --- ParallelTerminationStrategy: PID 23934 died... 04:01:45.375063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23934): Terminated: ok {rc=0} 04:01:45.421857 --- ParallelTerminationStrategy: PID 23937 died... 04:01:45.441416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23937): Terminated: ok {rc=0} 04:01:45.487757 --- ParallelTerminationStrategy: PID 23940 died... 04:01:45.507401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23940): Terminated: ok {rc=0} 04:01:45.594458 bus /gobi_0: Setting Powered False 04:01:46.690960 bus /gobi_0: Setting Powered False 04:01:47.807283 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:01:49.061910 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:01:49.068345 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:01:49.102227 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:01:49.137665 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:01:49.191331 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:01:49.225071 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:01:49.260327 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:01:49.817752 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:01:49.822905 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:49.834364 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:01:49.905074 tst switch_tch_pdch.py: using LAC 25847 04:01:50.029414 tst switch_tch_pdch.py: using RAC 92 04:01:50.151671 tst switch_tch_pdch.py: using CellId 25847 04:01:50.271366 tst switch_tch_pdch.py: using BVCI 25848 04:01:50.380586 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:50.391711 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:50.402672 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:50.414584 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:50.426359 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:50.438064 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:50.449817 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:01:50.461211 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:01:50.578239 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:01:50.693334 tst switch_tch_pdch.py:51: start network... 04:01:50.894152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:51.330494 run create_hlr_db(pid=23959): Launched 04:01:51.444595 bus /gobi_6: Setting Powered False 04:01:52.504513 run create_hlr_db(pid=23959): Terminated: ok {rc=0} 04:01:52.911653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23961): Launched 04:01:53.230242 run osmo-hlr_10.42.42.2(pid=23962): Launched 04:01:53.351598 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:53.872753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23964): Launched 04:01:54.191470 run osmo-stp_10.42.42.5(pid=23965): Launched 04:01:54.312923 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:54.835619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23967): Launched 04:01:54.957477 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:55.226709 run patchelf(pid=23968): Launched 04:01:55.404055 run osmo-stp_10.42.42.5(pid=23965): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23965)] 04:01:55.538929 run osmo-stp_10.42.42.5(pid=23965): stdout: | (launched: 2022-12-10_04:01:54.133509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:55.674417 run osmo-stp_10.42.42.5(pid=23965): stderr: | 20221210040154323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040154323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040154323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040154324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040154324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040154324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040154324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:55.809921 run osmo-stp_10.42.42.5(pid=23965): stdout: | (launched: 2022-12-10_04:01:54.133509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:55.939620 run osmo-stp_10.42.42.5(pid=23965): stderr: | 20221210040154323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040154323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040154323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040154324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040154324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040154324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040154324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:56.094027 run patchelf(pid=23968): Terminating (SIGINT) 04:01:56.271430 run patchelf(pid=23968): Terminated: ok {rc=0} 04:01:56.399617 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23965): Process ended prematurely: osmo-stp_10.42.42.5(pid=23965) [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23965)] [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:01:56.409680 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 04:01:56.438059 run osmo-hlr_10.42.42.2(pid=23962): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23962)] 04:01:56.487796 run osmo-hlr_10.42.42.2(pid=23962): stdout: | (launched: 2022-12-10_04:01:53.172076) 04:01:56.539019 run osmo-hlr_10.42.42.2(pid=23962): stderr: | 20221210040153369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040153369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040153369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040153369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040153369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040153370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040153382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040153391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040153391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040153391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:56.590798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23961): Terminating (SIGTERM) 04:01:56.632082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23964): Terminating (SIGTERM) 04:01:56.673267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23967): Terminating (SIGTERM) 04:01:56.714629 --- ParallelTerminationStrategy: PID 23961 died... 04:01:56.734479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23961): Terminated: ok {rc=0} 04:01:56.780132 --- ParallelTerminationStrategy: PID 23964 died... 04:01:56.799468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23964): Terminated: ok {rc=0} 04:01:56.845022 --- ParallelTerminationStrategy: PID 23967 died... 04:01:56.864629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23967): Terminated: ok {rc=0} 04:01:56.951477 bus /gobi_0: Setting Powered False 04:01:58.049948 bus /gobi_0: Setting Powered False 04:01:59.165068 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:00.419322 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:00.423664 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:00.458730 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 04:02:00.465975 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:02:00.519004 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:00.553448 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 04:02:00.560530 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:02:01.098147 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 04:02:01.104852 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 04:02:01.117461 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:01.172766 tst mo_mt_sms.py: using LAC 25848 04:02:01.322388 tst mo_mt_sms.py: using RAC 93 04:02:01.443435 tst mo_mt_sms.py: using CellId 25848 04:02:01.565580 tst mo_mt_sms.py: using BVCI 25849 04:02:01.715032 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:01.841242 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:01.959548 tst mo_mt_sms.py:9: start nitb and bts... 04:02:02.240291 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:02:02.858433 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23972): Launched 04:02:03.161725 run osmo-nitb_10.42.42.2(pid=23973): Launched 04:02:03.338676 run osmo-nitb_10.42.42.2(pid=23973): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23973)] 04:02:03.482171 run osmo-nitb_10.42.42.2(pid=23973): stdout: | (launched: 2022-12-10_04:02:03.102674) 04:02:03.626557 run osmo-nitb_10.42.42.2(pid=23973): stderr: | (launched: 2022-12-10_04:02:03.147067) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:03.771243 run osmo-nitb_10.42.42.2(pid=23973): stdout: | (launched: 2022-12-10_04:02:03.102674) 04:02:03.910158 run osmo-nitb_10.42.42.2(pid=23973): stderr: | (launched: 2022-12-10_04:02:03.147067) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23973) [trial-2369↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23973)] 04:02:04.281737 tst osmo-nitb_10.42.42.2(pid=23973): stdout: | (launched: 2022-12-10_04:02:03.102674) 04:02:04.409633 tst osmo-nitb_10.42.42.2(pid=23973): stderr: | (launched: 2022-12-10_04:02:03.147067) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:04.561214 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23973) [trial-2369↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23973)] [trial-2369↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 04:02:04.570444 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 04:02:04.577622 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23972): Terminating (SIGTERM) 04:02:04.788264 --- ParallelTerminationStrategy: PID 23972 died... 04:02:04.809900 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23972): Terminated: ok {rc=0} 04:02:04.897790 bus /sierra_3: Setting Powered False 04:02:05.998580 bus /sierra_3: Setting Powered False 04:02:07.115487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:08.312752 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:08.316715 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:08.351249 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:02:08.378030 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:02:08.429646 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:08.463220 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:02:08.489758 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:02:09.036266 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 04:02:09.041479 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:09.052100 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:09.099533 tst mo_mt_sms.py: using LAC 25849 04:02:09.216756 tst mo_mt_sms.py: using RAC 94 04:02:09.336882 tst mo_mt_sms.py: using CellId 25849 04:02:09.467704 tst mo_mt_sms.py: using BVCI 25850 04:02:09.578181 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:09.589149 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:09.599693 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:09.610516 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:09.621324 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:09.631881 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:09.748832 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:09.863644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:10.328218 run create_hlr_db(pid=23977): Launched 04:02:10.441801 bus /sierra_2: Setting Powered False 04:02:11.502111 run create_hlr_db(pid=23977): Terminated: ok {rc=0} 04:02:11.939105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23979): Launched 04:02:12.258508 run osmo-hlr_10.42.42.2(pid=23980): Launched 04:02:12.379696 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:12.930502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23982): Launched 04:02:13.248335 run osmo-stp_10.42.42.5(pid=23983): Launched 04:02:13.369619 run osmo-msc_10.42.42.6: Starting osmo-msc 04:02:13.945528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23985): Launched 04:02:14.262874 run osmo-msc_10.42.42.6(pid=23986): Launched 04:02:14.439857 run osmo-stp_10.42.42.5(pid=23983): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23983)] 04:02:14.577772 run osmo-stp_10.42.42.5(pid=23983): stdout: | (launched: 2022-12-10_04:02:13.190123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:14.713921 run osmo-stp_10.42.42.5(pid=23983): stderr: | 20221210040213382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040213382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040213383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040213383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040213384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040213384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040213384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:14.845574 run osmo-stp_10.42.42.5(pid=23983): stdout: | (launched: 2022-12-10_04:02:13.190123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:14.971838 run osmo-stp_10.42.42.5(pid=23983): stderr: | 20221210040213382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040213382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040213383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040213383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040213384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040213384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040213384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:15.123162 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23983): Process ended prematurely: osmo-stp_10.42.42.5(pid=23983) [trial-2369↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23983)] [trial-2369↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 04:02:15.131954 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 04:02:15.159429 run osmo-hlr_10.42.42.2(pid=23980): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23980)] 04:02:15.209208 run osmo-hlr_10.42.42.2(pid=23980): stdout: | (launched: 2022-12-10_04:02:12.200407) 04:02:15.260514 run osmo-hlr_10.42.42.2(pid=23980): stderr: | 20221210040212397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040212397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040212397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040212397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040212397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040212397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040212410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040212418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040212418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040212418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:15.332027 run osmo-msc_10.42.42.6(pid=23986): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23986)] 04:02:15.381507 run osmo-msc_10.42.42.6(pid=23986): stdout: | (launched: 2022-12-10_04:02:14.204601) 04:02:15.433067 run osmo-msc_10.42.42.6(pid=23986): stderr: | 20221210040214525 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040214525 DLGLOBAL DEBUG validating counter group 0x7f28a3312c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040214525 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040214525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040214526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040214526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040214527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040214528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040214528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040214528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:02:15.484729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23979): Terminating (SIGTERM) 04:02:15.526011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23982): Terminating (SIGTERM) 04:02:15.567254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23985): Terminating (SIGTERM) 04:02:15.608820 --- ParallelTerminationStrategy: PID 23979 died... 04:02:15.628658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23979): Terminated: ok {rc=0} 04:02:15.674410 --- ParallelTerminationStrategy: PID 23982 died... 04:02:15.693801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23982): Terminated: ok {rc=0} 04:02:15.739782 --- ParallelTerminationStrategy: PID 23985 died... 04:02:15.759184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23985): Terminated: ok {rc=0} 04:02:15.856577 bus /sierra_3: Setting Powered False 04:02:16.961185 bus /sierra_3: Setting Powered False 04:02:18.076276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:19.310618 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:19.314643 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:19.349148 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 04:02:19.356209 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 04:02:19.396348 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:19.431889 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 04:02:19.438778 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 04:02:19.951025 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 04:02:19.956140 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 04:02:19.966954 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:20.021198 tst assert_extension.py: using LAC 25850 04:02:20.137739 tst assert_extension.py: using RAC 95 04:02:20.253635 tst assert_extension.py: using CellId 25850 04:02:20.379739 tst assert_extension.py: using BVCI 25851 04:02:20.495159 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 04:02:20.609755 tst assert_extension.py:10: start nitb and bts... 04:02:20.809747 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:02:21.420026 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23991): Launched 04:02:21.719176 run osmo-nitb_10.42.42.2(pid=23992): Launched 04:02:21.885572 run osmo-nitb_10.42.42.2(pid=23992): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23992)] 04:02:22.019295 run osmo-nitb_10.42.42.2(pid=23992): stdout: | (launched: 2022-12-10_04:02:21.664191) 04:02:22.155654 run osmo-nitb_10.42.42.2(pid=23992): stderr: | (launched: 2022-12-10_04:02:21.708386) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:22.291575 run osmo-nitb_10.42.42.2(pid=23992): stdout: | (launched: 2022-12-10_04:02:21.664191) 04:02:22.422165 run osmo-nitb_10.42.42.2(pid=23992): stderr: | (launched: 2022-12-10_04:02:21.708386) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23992): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23992) [trial-2369↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23992)] 04:02:22.832303 tst osmo-nitb_10.42.42.2(pid=23992): stdout: | (launched: 2022-12-10_04:02:21.664191) 04:02:22.955062 tst osmo-nitb_10.42.42.2(pid=23992): stderr: | (launched: 2022-12-10_04:02:21.708386) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:23.097620 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23992): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23992) [trial-2369↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23992)] [trial-2369↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 04:02:23.106113 tst assert_extension.py:12: Test FAILED (3.1 sec) 04:02:23.113225 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23991): Terminating (SIGTERM) 04:02:23.322755 --- ParallelTerminationStrategy: PID 23991 died... 04:02:23.343582 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23991): Terminated: ok {rc=0} 04:02:23.431327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:24.611029 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:24.615148 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:24.650054 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:02:24.677511 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 04:02:24.712878 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:24.747145 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:02:24.774364 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 04:02:25.308435 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 04:02:25.313561 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:25.324730 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:25.376022 tst assert_extension.py: using LAC 25851 04:02:25.501341 tst assert_extension.py: using RAC 96 04:02:25.630911 tst assert_extension.py: using CellId 25851 04:02:25.753875 tst assert_extension.py: using BVCI 25852 04:02:25.868657 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:25.880215 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:25.891283 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:25.902399 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:25.913370 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:25.924281 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 04:02:26.035415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:26.500359 run create_hlr_db(pid=23996): Launched 04:02:26.616076 bus /sierra_2: Setting Powered False 04:02:27.676677 run create_hlr_db(pid=23996): Terminated: ok {rc=0} 04:02:28.094532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23998): Launched 04:02:28.395440 run osmo-hlr_10.42.42.2(pid=23999): Launched 04:02:28.509878 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:29.128534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24001): Launched 04:02:29.425688 run osmo-stp_10.42.42.5(pid=24002): Launched 04:02:29.539271 run osmo-msc_10.42.42.6: Starting osmo-msc 04:02:30.073194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24004): Launched 04:02:30.369276 run osmo-msc_10.42.42.6(pid=24005): Launched 04:02:30.534124 run osmo-stp_10.42.42.5(pid=24002): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24002)] 04:02:30.659732 run osmo-stp_10.42.42.5(pid=24002): stdout: | (launched: 2022-12-10_04:02:29.371221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:30.786411 run osmo-stp_10.42.42.5(pid=24002): stderr: | 20221210040229540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040229540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040229541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040229541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040229542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040229542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040229542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:30.912265 run osmo-stp_10.42.42.5(pid=24002): stdout: | (launched: 2022-12-10_04:02:29.371221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:31.033660 run osmo-stp_10.42.42.5(pid=24002): stderr: | 20221210040229540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040229540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040229541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040229541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040229542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040229542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040229542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:31.179343 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24002): Process ended prematurely: osmo-stp_10.42.42.5(pid=24002) [trial-2369↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24002)] [trial-2369↪ussd:trx-sysmocell5000↪assert_extension.py:17] 04:02:31.188791 tst assert_extension.py:17: Test FAILED (5.9 sec) 04:02:31.218414 run osmo-hlr_10.42.42.2(pid=23999): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23999)] 04:02:31.268505 run osmo-hlr_10.42.42.2(pid=23999): stdout: | (launched: 2022-12-10_04:02:28.339841) 04:02:31.320254 run osmo-hlr_10.42.42.2(pid=23999): stderr: | 20221210040228516 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040228516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040228516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040228516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040228516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040228516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040228528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040228536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040228537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040228537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:31.391540 run osmo-msc_10.42.42.6(pid=24005): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24005)] 04:02:31.441543 run osmo-msc_10.42.42.6(pid=24005): stdout: | (launched: 2022-12-10_04:02:30.315125) 04:02:31.493203 run osmo-msc_10.42.42.6(pid=24005): stderr: | 20221210040230590 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040230590 DLGLOBAL DEBUG validating counter group 0x7fb713c95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040230590 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040230591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040230591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040230591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040230593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040230593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040230593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040230593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:02:31.545538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23998): Terminating (SIGTERM) 04:02:31.587425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24001): Terminating (SIGTERM) 04:02:31.629817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24004): Terminating (SIGTERM) 04:02:31.673026 --- ParallelTerminationStrategy: PID 23998 died... 04:02:31.692850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23998): Terminated: ok {rc=0} 04:02:31.741774 --- ParallelTerminationStrategy: PID 24001 died... 04:02:31.761357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24001): Terminated: ok {rc=0} 04:02:31.808863 --- ParallelTerminationStrategy: PID 24004 died... 04:02:31.828519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24004): Terminated: ok {rc=0} 04:02:31.917812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:02:33.130326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:33.136712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:02:33.170928 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:02:33.197482 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:02:33.249606 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:02:33.283607 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:02:33.309881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:02:33.860197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:02:33.909300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:33.920337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:02:33.989435 tst mo_mt_call.py: using LAC 25852 04:02:34.108474 tst mo_mt_call.py: using RAC 97 04:02:34.226496 tst mo_mt_call.py: using CellId 25852 04:02:34.349719 tst mo_mt_call.py: using BVCI 25853 04:02:34.468416 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:34.480346 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:34.491990 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:34.503502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:34.515088 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:34.526903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:02:34.640331 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:02:34.755663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:35.221215 run create_hlr_db(pid=24010): Launched 04:02:35.336815 bus /sierra_2: Setting Powered False 04:02:36.400828 run create_hlr_db(pid=24010): Terminated: ok {rc=0} 04:02:36.831515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24012): Launched 04:02:37.132721 run osmo-hlr_10.42.42.2(pid=24013): Launched 04:02:37.248480 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:37.780079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24015): Launched 04:02:38.081088 run osmo-stp_10.42.42.5(pid=24016): Launched 04:02:38.197267 run osmo-msc_10.42.42.6: Starting osmo-msc 04:02:38.744123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24018): Launched 04:02:39.047203 run osmo-msc_10.42.42.6(pid=24019): Launched 04:02:39.216909 run osmo-stp_10.42.42.5(pid=24016): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24016)] 04:02:39.345461 run osmo-stp_10.42.42.5(pid=24016): stdout: | (launched: 2022-12-10_04:02:38.026025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:39.473857 run osmo-stp_10.42.42.5(pid=24016): stderr: | 20221210040238196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040238196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040238196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040238197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040238197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040238197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040238197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:39.599310 run osmo-stp_10.42.42.5(pid=24016): stdout: | (launched: 2022-12-10_04:02:38.026025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:39.719366 run osmo-stp_10.42.42.5(pid=24016): stderr: | 20221210040238196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040238196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040238196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040238197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040238197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040238197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040238197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:39.863249 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24016): Process ended prematurely: osmo-stp_10.42.42.5(pid=24016) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24016)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:02:39.872203 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:02:39.899128 run osmo-hlr_10.42.42.2(pid=24013): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24013)] 04:02:39.947417 run osmo-hlr_10.42.42.2(pid=24013): stdout: | (launched: 2022-12-10_04:02:37.077616) 04:02:39.997284 run osmo-hlr_10.42.42.2(pid=24013): stderr: | 20221210040237254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040237254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040237254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040237254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040237254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040237254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040237266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040237274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040237274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040237275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:40.066454 run osmo-msc_10.42.42.6(pid=24019): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24019)] 04:02:40.114390 run osmo-msc_10.42.42.6(pid=24019): stdout: | (launched: 2022-12-10_04:02:38.991809) 04:02:40.163926 run osmo-msc_10.42.42.6(pid=24019): stderr: | 20221210040239264 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040239264 DLGLOBAL DEBUG validating counter group 0x7f9b8145fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040239264 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040239264 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040239265 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040239265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040239267 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040239267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040239267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040239267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:02:40.213947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24012): Terminating (SIGTERM) 04:02:40.253665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24015): Terminating (SIGTERM) 04:02:40.293681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24018): Terminating (SIGTERM) 04:02:40.334096 --- ParallelTerminationStrategy: PID 24012 died... 04:02:40.353165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24012): Terminated: ok {rc=0} 04:02:40.397464 --- ParallelTerminationStrategy: PID 24015 died... 04:02:40.415868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24015): Terminated: ok {rc=0} 04:02:40.460165 --- ParallelTerminationStrategy: PID 24018 died... 04:02:40.478603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24018): Terminated: ok {rc=0} 04:02:40.564700 bus /sierra_3: Setting Powered False 04:02:41.665158 bus /sierra_3: Setting Powered False 04:02:42.781561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:02:43.928599 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:43.940613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:02:44.011571 tst mo_mt_call_osmux.py: using LAC 25853 04:02:44.130291 tst mo_mt_call_osmux.py: using RAC 98 04:02:44.254153 tst mo_mt_call_osmux.py: using CellId 25853 04:02:44.372564 tst mo_mt_call_osmux.py: using BVCI 25854 04:02:44.482995 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:44.494355 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:44.505647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:44.517593 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:44.529549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:02:44.541368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:02:44.661559 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:02:44.779162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:45.247785 run create_hlr_db(pid=24021): Launched 04:02:45.362802 bus /sierra_2: Setting Powered False 04:02:46.434442 run create_hlr_db(pid=24021): Terminated: ok {rc=0} 04:02:46.899318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24023): Launched 04:02:47.244418 run osmo-hlr_10.42.42.2(pid=24024): Launched 04:02:47.367613 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:47.924146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24026): Launched 04:02:48.245386 run osmo-stp_10.42.42.5(pid=24027): Launched 04:02:48.367175 run osmo-msc_10.42.42.6: Starting osmo-msc 04:02:48.946422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24029): Launched 04:02:49.266465 run osmo-msc_10.42.42.6(pid=24030): Launched 04:02:49.445318 run osmo-stp_10.42.42.5(pid=24027): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24027)] 04:02:49.580222 run osmo-stp_10.42.42.5(pid=24027): stdout: | (launched: 2022-12-10_04:02:48.186807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:49.715677 run osmo-stp_10.42.42.5(pid=24027): stderr: | 20221210040248378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040248378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040248378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040248379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040248381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040248381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040248381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:49.849847 run osmo-stp_10.42.42.5(pid=24027): stdout: | (launched: 2022-12-10_04:02:48.186807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:49.977128 run osmo-stp_10.42.42.5(pid=24027): stderr: | 20221210040248378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040248378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040248378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040248379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040248381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040248381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040248381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:50.129412 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24027): Process ended prematurely: osmo-stp_10.42.42.5(pid=24027) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24027)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:02:50.139177 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:02:50.166701 run osmo-hlr_10.42.42.2(pid=24024): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24024)] 04:02:50.216067 run osmo-hlr_10.42.42.2(pid=24024): stdout: | (launched: 2022-12-10_04:02:47.185052) 04:02:50.267124 run osmo-hlr_10.42.42.2(pid=24024): stderr: | 20221210040247383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040247383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040247383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040247383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040247383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040247383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040247396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040247404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040247404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040247405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:50.338148 run osmo-msc_10.42.42.6(pid=24030): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24030)] 04:02:50.387494 run osmo-msc_10.42.42.6(pid=24030): stdout: | (launched: 2022-12-10_04:02:49.208173) 04:02:50.439189 run osmo-msc_10.42.42.6(pid=24030): stderr: | 20221210040249530 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040249530 DLGLOBAL DEBUG validating counter group 0x7fcf46519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040249530 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040249530 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040249530 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040249531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040249532 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040249533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040249533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040249533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:02:50.490701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24023): Terminating (SIGTERM) 04:02:50.532322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24026): Terminating (SIGTERM) 04:02:50.573604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24029): Terminating (SIGTERM) 04:02:50.615102 --- ParallelTerminationStrategy: PID 24023 died... 04:02:50.634875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24023): Terminated: ok {rc=0} 04:02:50.680710 --- ParallelTerminationStrategy: PID 24026 died... 04:02:50.700114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24026): Terminated: ok {rc=0} 04:02:50.745703 --- ParallelTerminationStrategy: PID 24029 died... 04:02:50.765098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24029): Terminated: ok {rc=0} 04:02:50.851428 bus /sierra_3: Setting Powered False 04:02:51.950100 bus /sierra_3: Setting Powered False 04:02:53.066001 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:02:54.323139 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:54.330267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:02:54.364806 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:02:54.392304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:02:54.445156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:02:54.479745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:02:54.507203 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:02:55.060571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:02:55.111876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:02:55.123565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:02:55.196201 tst mo_mt_call.py: using LAC 25854 04:02:55.322909 tst mo_mt_call.py: using RAC 99 04:02:55.448909 tst mo_mt_call.py: using CellId 25854 04:02:55.575197 tst mo_mt_call.py: using BVCI 25855 04:02:55.692590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:02:55.704361 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:02:55.715968 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:02:55.727513 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:02:55.739127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:02:55.750691 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:02:55.865652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:02:55.983385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:56.479738 run create_hlr_db(pid=24035): Launched 04:02:56.602257 bus /sierra_2: Setting Powered False 04:02:57.662950 run create_hlr_db(pid=24035): Terminated: ok {rc=0} 04:02:58.083532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24037): Launched 04:02:58.384830 run osmo-hlr_10.42.42.2(pid=24038): Launched 04:02:58.499875 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:59.036067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24040): Launched 04:02:59.337545 run osmo-stp_10.42.42.5(pid=24041): Launched 04:02:59.452838 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:00.001763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24043): Launched 04:03:00.302917 run osmo-msc_10.42.42.6(pid=24044): Launched 04:03:00.471941 run osmo-stp_10.42.42.5(pid=24041): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24041)] 04:03:00.599970 run osmo-stp_10.42.42.5(pid=24041): stdout: | (launched: 2022-12-10_04:02:59.282308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:00.727884 run osmo-stp_10.42.42.5(pid=24041): stderr: | 20221210040259453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040259454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040259454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040259454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040259455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040259455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040259455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:00.877379 run osmo-stp_10.42.42.5(pid=24041): stdout: | (launched: 2022-12-10_04:02:59.282308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:01.012170 run osmo-stp_10.42.42.5(pid=24041): stderr: | 20221210040259453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040259454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040259454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040259454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040259455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040259455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040259455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:01.170532 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24041): Process ended prematurely: osmo-stp_10.42.42.5(pid=24041) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24041)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:03:01.180748 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:03:01.210731 run osmo-hlr_10.42.42.2(pid=24038): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24038)] 04:03:01.262340 run osmo-hlr_10.42.42.2(pid=24038): stdout: | (launched: 2022-12-10_04:02:58.329695) 04:03:01.315235 run osmo-hlr_10.42.42.2(pid=24038): stderr: | 20221210040258506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040258506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040258506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040258506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040258506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040258506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040258518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040258526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040258526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040258527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:01.388995 run osmo-msc_10.42.42.6(pid=24044): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24044)] 04:03:01.441554 run osmo-msc_10.42.42.6(pid=24044): stdout: | (launched: 2022-12-10_04:03:00.247220) 04:03:01.495042 run osmo-msc_10.42.42.6(pid=24044): stderr: | 20221210040300519 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040300520 DLGLOBAL DEBUG validating counter group 0x7f78a8c49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040300520 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040300520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040300520 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040300520 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040300522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040300523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040300523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040300523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:01.548156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24037): Terminating (SIGTERM) 04:03:01.592742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24040): Terminating (SIGTERM) 04:03:01.637419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24043): Terminating (SIGTERM) 04:03:01.682989 --- ParallelTerminationStrategy: PID 24037 died... 04:03:01.703276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24037): Terminated: ok {rc=0} 04:03:01.751517 --- ParallelTerminationStrategy: PID 24040 died... 04:03:01.771775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24040): Terminated: ok {rc=0} 04:03:01.822291 --- ParallelTerminationStrategy: PID 24043 died... 04:03:01.842362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24043): Terminated: ok {rc=0} 04:03:01.932325 bus /sierra_3: Setting Powered False 04:03:03.031849 bus /sierra_3: Setting Powered False 04:03:04.146218 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:03:05.293610 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:05.305968 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:03:05.377953 tst mo_mt_call_osmux.py: using LAC 25855 04:03:05.507316 tst mo_mt_call_osmux.py: using RAC 100 04:03:05.631531 tst mo_mt_call_osmux.py: using CellId 25855 04:03:05.756063 tst mo_mt_call_osmux.py: using BVCI 25856 04:03:05.872070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:05.883933 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:05.895500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:05.907023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:05.918668 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:05.930330 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:06.045927 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:06.164590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:06.662639 run create_hlr_db(pid=24047): Launched 04:03:06.791716 bus /sierra_2: Setting Powered False 04:03:07.854926 run create_hlr_db(pid=24047): Terminated: ok {rc=0} 04:03:08.300693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24049): Launched 04:03:08.621663 run osmo-hlr_10.42.42.2(pid=24050): Launched 04:03:08.743017 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:09.292526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24052): Launched 04:03:09.613646 run osmo-stp_10.42.42.5(pid=24053): Launched 04:03:09.735753 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:10.316484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24055): Launched 04:03:10.638999 run osmo-msc_10.42.42.6(pid=24056): Launched 04:03:10.817482 run osmo-stp_10.42.42.5(pid=24053): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24053)] 04:03:10.952332 run osmo-stp_10.42.42.5(pid=24053): stdout: | (launched: 2022-12-10_04:03:09.555057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:11.088067 run osmo-stp_10.42.42.5(pid=24053): stderr: | 20221210040309745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040309745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040309746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040309746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040309748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040309748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040309749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:11.222348 run osmo-stp_10.42.42.5(pid=24053): stdout: | (launched: 2022-12-10_04:03:09.555057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:11.349849 run osmo-stp_10.42.42.5(pid=24053): stderr: | 20221210040309745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040309745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040309746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040309746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040309748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040309748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040309749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:11.503175 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24053): Process ended prematurely: osmo-stp_10.42.42.5(pid=24053) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24053)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:03:11.512803 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:03:11.540539 run osmo-hlr_10.42.42.2(pid=24050): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24050)] 04:03:11.590172 run osmo-hlr_10.42.42.2(pid=24050): stdout: | (launched: 2022-12-10_04:03:08.562995) 04:03:11.641577 run osmo-hlr_10.42.42.2(pid=24050): stderr: | 20221210040308760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040308760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040308761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040308761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040308761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040308761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040308793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040308804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040308804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040308804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:11.713227 run osmo-msc_10.42.42.6(pid=24056): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24056)] 04:03:11.762629 run osmo-msc_10.42.42.6(pid=24056): stdout: | (launched: 2022-12-10_04:03:10.580024) 04:03:11.813710 run osmo-msc_10.42.42.6(pid=24056): stderr: | 20221210040310903 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040310903 DLGLOBAL DEBUG validating counter group 0x7f8a6fb82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040310903 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040310903 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040310904 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040310904 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040310905 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040310906 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040310906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040310906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:11.865146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24049): Terminating (SIGTERM) 04:03:11.906177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24052): Terminating (SIGTERM) 04:03:11.947490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24055): Terminating (SIGTERM) 04:03:11.988890 --- ParallelTerminationStrategy: PID 24049 died... 04:03:12.008314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24049): Terminated: ok {rc=0} 04:03:12.054344 --- ParallelTerminationStrategy: PID 24052 died... 04:03:12.073705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24052): Terminated: ok {rc=0} 04:03:12.119363 --- ParallelTerminationStrategy: PID 24055 died... 04:03:12.138603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24055): Terminated: ok {rc=0} 04:03:12.225280 bus /sierra_3: Setting Powered False 04:03:13.321608 bus /sierra_3: Setting Powered False 04:03:14.436583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:03:15.692835 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:15.699872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:03:15.734349 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:03:15.761724 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:03:15.815241 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:03:15.855736 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:03:15.888308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:03:16.431403 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:03:16.486306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:16.498731 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:03:16.570962 tst mo_mt_call.py: using LAC 25856 04:03:16.693181 tst mo_mt_call.py: using RAC 101 04:03:16.821545 tst mo_mt_call.py: using CellId 25856 04:03:16.963599 tst mo_mt_call.py: using BVCI 25857 04:03:17.083286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:17.095951 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:17.109175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:17.121575 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:17.134374 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:17.146719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:03:17.267460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:03:17.388566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:17.885947 run create_hlr_db(pid=24061): Launched 04:03:18.016407 bus /sierra_2: Setting Powered False 04:03:19.080563 run create_hlr_db(pid=24061): Terminated: ok {rc=0} 04:03:19.511215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24063): Launched 04:03:19.813224 run osmo-hlr_10.42.42.2(pid=24064): Launched 04:03:19.928539 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:20.447324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24066): Launched 04:03:20.750724 run osmo-stp_10.42.42.5(pid=24067): Launched 04:03:20.865678 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:21.411632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24069): Launched 04:03:21.713226 run osmo-msc_10.42.42.6(pid=24070): Launched 04:03:21.882422 run osmo-stp_10.42.42.5(pid=24067): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24067)] 04:03:22.011027 run osmo-stp_10.42.42.5(pid=24067): stdout: | (launched: 2022-12-10_04:03:20.695274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:22.139292 run osmo-stp_10.42.42.5(pid=24067): stderr: | 20221210040320865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040320865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040320865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040320866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040320868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040320868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040320868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:22.265153 run osmo-stp_10.42.42.5(pid=24067): stdout: | (launched: 2022-12-10_04:03:20.695274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:22.385232 run osmo-stp_10.42.42.5(pid=24067): stderr: | 20221210040320865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040320865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040320865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040320866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040320868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040320868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040320868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:22.529230 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24067): Process ended prematurely: osmo-stp_10.42.42.5(pid=24067) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24067)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:03:22.538395 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:03:22.565629 run osmo-hlr_10.42.42.2(pid=24064): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24064)] 04:03:22.613346 run osmo-hlr_10.42.42.2(pid=24064): stdout: | (launched: 2022-12-10_04:03:19.757769) 04:03:22.662672 run osmo-hlr_10.42.42.2(pid=24064): stderr: | 20221210040319931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040319931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040319931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040319931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040319931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040319931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040319962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040319972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040319972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040319972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:22.731455 run osmo-msc_10.42.42.6(pid=24070): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24070)] 04:03:22.778776 run osmo-msc_10.42.42.6(pid=24070): stdout: | (launched: 2022-12-10_04:03:21.658027) 04:03:22.827815 run osmo-msc_10.42.42.6(pid=24070): stderr: | 20221210040321930 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040321930 DLGLOBAL DEBUG validating counter group 0x7fa4b20bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040321930 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040321930 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040321930 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040321931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040321932 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040321933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040321933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040321933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:22.877149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24063): Terminating (SIGTERM) 04:03:22.916515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24066): Terminating (SIGTERM) 04:03:22.955951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24069): Terminating (SIGTERM) 04:03:22.995733 --- ParallelTerminationStrategy: PID 24063 died... 04:03:23.014608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24063): Terminated: ok {rc=0} 04:03:23.058685 --- ParallelTerminationStrategy: PID 24066 died... 04:03:23.077183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24066): Terminated: ok {rc=0} 04:03:23.121344 --- ParallelTerminationStrategy: PID 24069 died... 04:03:23.139647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24069): Terminated: ok {rc=0} 04:03:23.222982 bus /sierra_3: Setting Powered False 04:03:24.320934 bus /sierra_3: Setting Powered False 04:03:25.437220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:03:26.582930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:26.594840 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:03:26.665416 tst mo_mt_call_osmux.py: using LAC 25857 04:03:26.786314 tst mo_mt_call_osmux.py: using RAC 102 04:03:26.904743 tst mo_mt_call_osmux.py: using CellId 25857 04:03:27.022846 tst mo_mt_call_osmux.py: using BVCI 25858 04:03:27.134067 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:27.145347 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:27.156292 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:27.167537 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:27.178984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:27.190207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:03:27.304245 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:03:27.421113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:27.890567 run create_hlr_db(pid=24072): Launched 04:03:28.005272 bus /sierra_2: Setting Powered False 04:03:29.065940 run create_hlr_db(pid=24072): Terminated: ok {rc=0} 04:03:29.488262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24074): Launched 04:03:29.791883 run osmo-hlr_10.42.42.2(pid=24075): Launched 04:03:29.907948 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:30.439836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24077): Launched 04:03:30.742317 run osmo-stp_10.42.42.5(pid=24078): Launched 04:03:30.945959 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:31.560427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24080): Launched 04:03:31.909730 run osmo-msc_10.42.42.6(pid=24081): Launched 04:03:32.179148 run osmo-stp_10.42.42.5(pid=24078): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24078)] 04:03:32.416070 run osmo-stp_10.42.42.5(pid=24078): stdout: | (launched: 2022-12-10_04:03:30.686436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:32.559446 run osmo-stp_10.42.42.5(pid=24078): stderr: | 20221210040330859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040330859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040330859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040330860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040330860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040330860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040330860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:32.697057 run osmo-stp_10.42.42.5(pid=24078): stdout: | (launched: 2022-12-10_04:03:30.686436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:32.826401 run osmo-stp_10.42.42.5(pid=24078): stderr: | 20221210040330859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040330859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040330859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040330860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040330860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040330860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040330860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:32.980118 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24078): Process ended prematurely: osmo-stp_10.42.42.5(pid=24078) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24078)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:03:32.990143 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:03:33.018098 run osmo-hlr_10.42.42.2(pid=24075): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24075)] 04:03:33.067946 run osmo-hlr_10.42.42.2(pid=24075): stdout: | (launched: 2022-12-10_04:03:29.735802) 04:03:33.120055 run osmo-hlr_10.42.42.2(pid=24075): stderr: | 20221210040329912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040329912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040329912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040329912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040329912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040329912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040329926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040329937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040329937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040329937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:33.191892 run osmo-msc_10.42.42.6(pid=24081): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24081)] 04:03:33.241812 run osmo-msc_10.42.42.6(pid=24081): stdout: | (launched: 2022-12-10_04:03:31.842638) 04:03:33.293331 run osmo-msc_10.42.42.6(pid=24081): stderr: | 20221210040332424 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040332424 DLGLOBAL DEBUG validating counter group 0x7ff9c7d16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040332425 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040332425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040332425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040332425 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040332427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040332427 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040332427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040332427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:33.345221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24074): Terminating (SIGTERM) 04:03:33.386709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24077): Terminating (SIGTERM) 04:03:33.428309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24080): Terminating (SIGTERM) 04:03:33.470380 --- ParallelTerminationStrategy: PID 24074 died... 04:03:33.490383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24074): Terminated: ok {rc=0} 04:03:33.536648 --- ParallelTerminationStrategy: PID 24077 died... 04:03:33.556143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24077): Terminated: ok {rc=0} 04:03:33.602235 --- ParallelTerminationStrategy: PID 24080 died... 04:03:33.621804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24080): Terminated: ok {rc=0} 04:03:33.709111 bus /sierra_3: Setting Powered False 04:03:34.809116 bus /sierra_3: Setting Powered False 04:03:35.922687 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:03:37.178341 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:37.185415 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:03:37.219779 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:03:37.246689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:03:37.299762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:03:37.334297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:03:37.361722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:03:37.919799 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:03:37.971558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:37.983210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:03:38.054623 tst mo_mt_call.py: using LAC 25858 04:03:38.181652 tst mo_mt_call.py: using RAC 103 04:03:38.306966 tst mo_mt_call.py: using CellId 25858 04:03:38.434680 tst mo_mt_call.py: using BVCI 25859 04:03:38.552722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:38.564476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:38.576017 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:38.587523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:38.599204 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:38.610736 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:03:38.725182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:03:38.841172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:39.306622 run create_hlr_db(pid=24086): Launched 04:03:39.421586 bus /sierra_2: Setting Powered False 04:03:40.482100 run create_hlr_db(pid=24086): Terminated: ok {rc=0} 04:03:40.921217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24088): Launched 04:03:41.243352 run osmo-hlr_10.42.42.2(pid=24089): Launched 04:03:41.365845 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:41.917299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24091): Launched 04:03:42.237667 run osmo-stp_10.42.42.5(pid=24092): Launched 04:03:42.359687 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:42.942891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24094): Launched 04:03:43.264390 run osmo-msc_10.42.42.6(pid=24095): Launched 04:03:43.443542 run osmo-stp_10.42.42.5(pid=24092): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24092)] 04:03:43.579724 run osmo-stp_10.42.42.5(pid=24092): stdout: | (launched: 2022-12-10_04:03:42.179175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:43.715564 run osmo-stp_10.42.42.5(pid=24092): stderr: | 20221210040342370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040342370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040342370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040342371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040342371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040342371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040342371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:43.851077 run osmo-stp_10.42.42.5(pid=24092): stdout: | (launched: 2022-12-10_04:03:42.179175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:43.978876 run osmo-stp_10.42.42.5(pid=24092): stderr: | 20221210040342370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040342370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040342370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040342371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040342371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040342371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040342371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:44.131839 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24092): Process ended prematurely: osmo-stp_10.42.42.5(pid=24092) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24092)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:03:44.141461 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:03:44.169367 run osmo-hlr_10.42.42.2(pid=24089): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24089)] 04:03:44.218715 run osmo-hlr_10.42.42.2(pid=24089): stdout: | (launched: 2022-12-10_04:03:41.184812) 04:03:44.270203 run osmo-hlr_10.42.42.2(pid=24089): stderr: | 20221210040341382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040341382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040341382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040341382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040341382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040341382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040341394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040341403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040341403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040341403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:44.341920 run osmo-msc_10.42.42.6(pid=24095): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24095)] 04:03:44.391240 run osmo-msc_10.42.42.6(pid=24095): stdout: | (launched: 2022-12-10_04:03:43.205754) 04:03:44.442355 run osmo-msc_10.42.42.6(pid=24095): stderr: | 20221210040343530 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040343530 DLGLOBAL DEBUG validating counter group 0x7f22432c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040343530 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040343530 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040343531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040343531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040343532 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040343533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040343533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040343533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:44.494122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24088): Terminating (SIGTERM) 04:03:44.535501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24091): Terminating (SIGTERM) 04:03:44.576738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24094): Terminating (SIGTERM) 04:03:44.618097 --- ParallelTerminationStrategy: PID 24088 died... 04:03:44.637793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24088): Terminated: ok {rc=0} 04:03:44.683406 --- ParallelTerminationStrategy: PID 24091 died... 04:03:44.702745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24091): Terminated: ok {rc=0} 04:03:44.748365 --- ParallelTerminationStrategy: PID 24094 died... 04:03:44.767674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24094): Terminated: ok {rc=0} 04:03:44.854646 bus /sierra_3: Setting Powered False 04:03:45.952027 bus /sierra_3: Setting Powered False 04:03:47.085446 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:03:48.234295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:48.246591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:03:48.318985 tst mo_mt_call_osmux.py: using LAC 25859 04:03:48.451748 tst mo_mt_call_osmux.py: using RAC 104 04:03:48.578876 tst mo_mt_call_osmux.py: using CellId 25859 04:03:48.702525 tst mo_mt_call_osmux.py: using BVCI 25860 04:03:48.818693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:48.830405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:48.841881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:48.853492 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:48.865104 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:03:48.876719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:03:48.991813 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:03:49.111600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:49.610983 run create_hlr_db(pid=24097): Launched 04:03:49.741799 bus /sierra_2: Setting Powered False 04:03:50.806214 run create_hlr_db(pid=24097): Terminated: ok {rc=0} 04:03:51.254743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24099): Launched 04:03:51.576565 run osmo-hlr_10.42.42.2(pid=24100): Launched 04:03:51.699732 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:52.258056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24102): Launched 04:03:52.580417 run osmo-stp_10.42.42.5(pid=24103): Launched 04:03:52.703319 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:53.286455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24105): Launched 04:03:53.608500 run osmo-msc_10.42.42.6(pid=24106): Launched 04:03:53.787574 run osmo-stp_10.42.42.5(pid=24103): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24103)] 04:03:53.922777 run osmo-stp_10.42.42.5(pid=24103): stdout: | (launched: 2022-12-10_04:03:52.521672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:54.058604 run osmo-stp_10.42.42.5(pid=24103): stderr: | 20221210040352716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040352716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040352716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040352716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040352717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040352717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040352717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:54.193244 run osmo-stp_10.42.42.5(pid=24103): stdout: | (launched: 2022-12-10_04:03:52.521672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:54.321173 run osmo-stp_10.42.42.5(pid=24103): stderr: | 20221210040352716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040352716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040352716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040352716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040352717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040352717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040352717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:54.474768 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24103): Process ended prematurely: osmo-stp_10.42.42.5(pid=24103) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24103)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:03:54.484631 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:03:54.512628 run osmo-hlr_10.42.42.2(pid=24100): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24100)] 04:03:54.562561 run osmo-hlr_10.42.42.2(pid=24100): stdout: | (launched: 2022-12-10_04:03:51.518181) 04:03:54.614014 run osmo-hlr_10.42.42.2(pid=24100): stderr: | 20221210040351717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040351717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040351717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040351717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040351717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040351717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040351730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040351738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040351738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040351738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:54.685272 run osmo-msc_10.42.42.6(pid=24106): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24106)] 04:03:54.734874 run osmo-msc_10.42.42.6(pid=24106): stdout: | (launched: 2022-12-10_04:03:53.549853) 04:03:54.785931 run osmo-msc_10.42.42.6(pid=24106): stderr: | 20221210040353875 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040353875 DLGLOBAL DEBUG validating counter group 0x7f04c4ce3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040353875 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040353875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040353875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040353875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040353877 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040353878 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040353878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040353878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:54.837560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24099): Terminating (SIGTERM) 04:03:54.878572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24102): Terminating (SIGTERM) 04:03:54.919745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24105): Terminating (SIGTERM) 04:03:54.961731 --- ParallelTerminationStrategy: PID 24099 died... 04:03:54.981494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24099): Terminated: ok {rc=0} 04:03:55.027610 --- ParallelTerminationStrategy: PID 24102 died... 04:03:55.047084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24102): Terminated: ok {rc=0} 04:03:55.092863 --- ParallelTerminationStrategy: PID 24105 died... 04:03:55.112591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24105): Terminated: ok {rc=0} 04:03:55.199339 bus /sierra_3: Setting Powered False 04:03:56.298257 bus /sierra_3: Setting Powered False 04:03:57.411762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:03:58.674332 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:58.681721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:03:58.716668 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:03:58.744081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:03:58.795569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:03:58.829997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:03:58.857669 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:03:59.411747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:03:59.463378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:03:59.475562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:03:59.546663 tst mo_mt_call.py: using LAC 25860 04:03:59.673499 tst mo_mt_call.py: using RAC 105 04:03:59.797457 tst mo_mt_call.py: using CellId 25860 04:03:59.921354 tst mo_mt_call.py: using BVCI 25861 04:04:00.037851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:00.049605 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:00.061153 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:00.072715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:00.084487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:00.096050 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:00.215947 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:00.332806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:00.802322 run create_hlr_db(pid=24111): Launched 04:04:00.961935 bus /sierra_2: Setting Powered False 04:04:02.021211 run create_hlr_db(pid=24111): Terminated: ok {rc=0} 04:04:02.449502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Launched 04:04:02.751778 run osmo-hlr_10.42.42.2(pid=24114): Launched 04:04:02.866757 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:03.385188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Launched 04:04:03.687691 run osmo-stp_10.42.42.5(pid=24117): Launched 04:04:03.804311 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:04.351862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Launched 04:04:04.656311 run osmo-msc_10.42.42.6(pid=24120): Launched 04:04:04.826417 run osmo-stp_10.42.42.5(pid=24117): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] 04:04:04.955986 run osmo-stp_10.42.42.5(pid=24117): stdout: | (launched: 2022-12-10_04:04:03.632458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:05.085620 run osmo-stp_10.42.42.5(pid=24117): stderr: | 20221210040403802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040403802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040403802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040403803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040403803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040403803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040403803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:05.212336 run osmo-stp_10.42.42.5(pid=24117): stdout: | (launched: 2022-12-10_04:04:03.632458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:05.333544 run osmo-stp_10.42.42.5(pid=24117): stderr: | 20221210040403802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040403802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040403802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040403803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040403803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040403803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040403803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:05.478299 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24117): Process ended prematurely: osmo-stp_10.42.42.5(pid=24117) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:04:05.487211 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:04:05.514264 run osmo-hlr_10.42.42.2(pid=24114): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24114)] 04:04:05.562062 run osmo-hlr_10.42.42.2(pid=24114): stdout: | (launched: 2022-12-10_04:04:02.696521) 04:04:05.611680 run osmo-hlr_10.42.42.2(pid=24114): stderr: | 20221210040402874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040402874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040402874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040402874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040402874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040402875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040402894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040402903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040402903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040402903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:05.680346 run osmo-msc_10.42.42.6(pid=24120): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24120)] 04:04:05.727842 run osmo-msc_10.42.42.6(pid=24120): stdout: | (launched: 2022-12-10_04:04:04.600483) 04:04:05.777162 run osmo-msc_10.42.42.6(pid=24120): stderr: | 20221210040404873 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040404873 DLGLOBAL DEBUG validating counter group 0x7fe3cfeafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040404873 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040404873 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040404873 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040404873 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040404877 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040404878 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040404878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040404878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:05.826944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Terminating (SIGTERM) 04:04:05.866865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Terminating (SIGTERM) 04:04:05.906768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Terminating (SIGTERM) 04:04:05.947086 --- ParallelTerminationStrategy: PID 24113 died... 04:04:05.966196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Terminated: ok {rc=0} 04:04:06.010830 --- ParallelTerminationStrategy: PID 24116 died... 04:04:06.029500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Terminated: ok {rc=0} 04:04:06.073802 --- ParallelTerminationStrategy: PID 24119 died... 04:04:06.092457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Terminated: ok {rc=0} 04:04:06.176344 bus /sierra_3: Setting Powered False 04:04:07.273968 bus /sierra_3: Setting Powered False 04:04:08.389554 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:04:09.538351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:09.550851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:04:09.623754 tst mo_mt_call_osmux.py: using LAC 25861 04:04:09.751577 tst mo_mt_call_osmux.py: using RAC 106 04:04:09.877278 tst mo_mt_call_osmux.py: using CellId 25861 04:04:10.004247 tst mo_mt_call_osmux.py: using BVCI 25862 04:04:10.120498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:10.132348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:10.143966 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:10.155570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:10.167191 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:10.178733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:10.297385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:10.413524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:10.883240 run create_hlr_db(pid=24122): Launched 04:04:10.999993 bus /sierra_2: Setting Powered False 04:04:12.061341 run create_hlr_db(pid=24122): Terminated: ok {rc=0} 04:04:12.502971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24124): Launched 04:04:12.821251 run osmo-hlr_10.42.42.2(pid=24125): Launched 04:04:12.944555 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:13.500516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24127): Launched 04:04:13.822182 run osmo-stp_10.42.42.5(pid=24128): Launched 04:04:13.944288 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:14.527581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24130): Launched 04:04:14.850085 run osmo-msc_10.42.42.6(pid=24131): Launched 04:04:15.030045 run osmo-stp_10.42.42.5(pid=24128): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24128)] 04:04:15.166493 run osmo-stp_10.42.42.5(pid=24128): stdout: | (launched: 2022-12-10_04:04:13.763506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:15.302892 run osmo-stp_10.42.42.5(pid=24128): stderr: | 20221210040413954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040413954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040413955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040413955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040413957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040413958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040413958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:15.437939 run osmo-stp_10.42.42.5(pid=24128): stdout: | (launched: 2022-12-10_04:04:13.763506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:15.566844 run osmo-stp_10.42.42.5(pid=24128): stderr: | 20221210040413954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040413954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040413955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040413955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040413957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040413958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040413958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:15.720120 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24128): Process ended prematurely: osmo-stp_10.42.42.5(pid=24128) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24128)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:04:15.729959 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:04:15.757655 run osmo-hlr_10.42.42.2(pid=24125): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24125)] 04:04:15.807101 run osmo-hlr_10.42.42.2(pid=24125): stdout: | (launched: 2022-12-10_04:04:12.762295) 04:04:15.863427 run osmo-hlr_10.42.42.2(pid=24125): stderr: | 20221210040412958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040412958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040412958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040412958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040412958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040412958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040412972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040412982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040412982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040412982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:15.950241 run osmo-msc_10.42.42.6(pid=24131): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24131)] 04:04:16.001565 run osmo-msc_10.42.42.6(pid=24131): stdout: | (launched: 2022-12-10_04:04:14.791065) 04:04:16.054688 run osmo-msc_10.42.42.6(pid=24131): stderr: | 20221210040415111 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040415111 DLGLOBAL DEBUG validating counter group 0x7f8b444edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040415111 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040415111 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040415111 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040415112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040415113 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040415114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040415114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040415114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:16.108016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24124): Terminating (SIGTERM) 04:04:16.150648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24127): Terminating (SIGTERM) 04:04:16.193395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24130): Terminating (SIGTERM) 04:04:16.236350 --- ParallelTerminationStrategy: PID 24124 died... 04:04:16.256779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24124): Terminated: ok {rc=0} 04:04:16.304123 --- ParallelTerminationStrategy: PID 24127 died... 04:04:16.324425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24127): Terminated: ok {rc=0} 04:04:16.371176 --- ParallelTerminationStrategy: PID 24130 died... 04:04:16.391210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24130): Terminated: ok {rc=0} 04:04:16.480424 bus /sierra_3: Setting Powered False 04:04:17.576382 bus /sierra_3: Setting Powered False 04:04:18.691121 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:04:19.947450 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:04:19.953983 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:04:19.987913 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:04:20.015997 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:04:20.067592 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:04:20.101147 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:04:20.127585 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:04:20.679919 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:04:20.729266 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:20.740604 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:04:20.810640 tst mo_mt_call.py: using LAC 25862 04:04:20.929457 tst mo_mt_call.py: using RAC 107 04:04:21.049413 tst mo_mt_call.py: using CellId 25862 04:04:21.176426 tst mo_mt_call.py: using BVCI 25863 04:04:21.286867 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:21.298453 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:21.309712 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:21.321351 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:21.333082 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:21.344726 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:04:21.464884 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:04:21.582740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:22.053599 run create_hlr_db(pid=24136): Launched 04:04:22.168890 bus /sierra_2: Setting Powered False 04:04:23.229909 run create_hlr_db(pid=24136): Terminated: ok {rc=0} 04:04:23.651830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24138): Launched 04:04:23.954917 run osmo-hlr_10.42.42.2(pid=24139): Launched 04:04:24.070036 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:24.603918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24141): Launched 04:04:24.907407 run osmo-stp_10.42.42.5(pid=24142): Launched 04:04:25.022665 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:25.571119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24144): Launched 04:04:25.873312 run osmo-msc_10.42.42.6(pid=24145): Launched 04:04:26.042675 run osmo-stp_10.42.42.5(pid=24142): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24142)] 04:04:26.171568 run osmo-stp_10.42.42.5(pid=24142): stdout: | (launched: 2022-12-10_04:04:24.852011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:26.300052 run osmo-stp_10.42.42.5(pid=24142): stderr: | 20221210040425023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040425023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040425023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040425023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040425024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040425024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040425024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:26.426360 run osmo-stp_10.42.42.5(pid=24142): stdout: | (launched: 2022-12-10_04:04:24.852011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:26.547332 run osmo-stp_10.42.42.5(pid=24142): stderr: | 20221210040425023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040425023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040425023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040425023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040425024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040425024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040425024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:26.691883 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24142): Process ended prematurely: osmo-stp_10.42.42.5(pid=24142) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24142)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:04:26.701300 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:04:26.728433 run osmo-hlr_10.42.42.2(pid=24139): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24139)] 04:04:26.776196 run osmo-hlr_10.42.42.2(pid=24139): stdout: | (launched: 2022-12-10_04:04:23.899451) 04:04:26.825591 run osmo-hlr_10.42.42.2(pid=24139): stderr: | 20221210040424075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040424075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040424075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040424075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040424075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040424075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040424087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040424095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040424095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040424096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:26.894720 run osmo-msc_10.42.42.6(pid=24145): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24145)] 04:04:26.942347 run osmo-msc_10.42.42.6(pid=24145): stdout: | (launched: 2022-12-10_04:04:25.817821) 04:04:26.991576 run osmo-msc_10.42.42.6(pid=24145): stderr: | 20221210040426089 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040426089 DLGLOBAL DEBUG validating counter group 0x7f7c28998c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040426089 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040426089 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040426089 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040426090 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040426091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040426092 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040426092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040426092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:27.041478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24138): Terminating (SIGTERM) 04:04:27.081270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24141): Terminating (SIGTERM) 04:04:27.121531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24144): Terminating (SIGTERM) 04:04:27.161422 --- ParallelTerminationStrategy: PID 24138 died... 04:04:27.180587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24138): Terminated: ok {rc=0} 04:04:27.224878 --- ParallelTerminationStrategy: PID 24141 died... 04:04:27.243343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24141): Terminated: ok {rc=0} 04:04:27.288675 --- ParallelTerminationStrategy: PID 24144 died... 04:04:27.307082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24144): Terminated: ok {rc=0} 04:04:27.392347 bus /sierra_3: Setting Powered False 04:04:28.491416 bus /sierra_3: Setting Powered False 04:04:29.607353 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:04:30.752839 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:30.764710 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:04:30.834372 tst mo_mt_call_osmux.py: using LAC 25863 04:04:30.988288 tst mo_mt_call_osmux.py: using RAC 108 04:04:31.110537 tst mo_mt_call_osmux.py: using CellId 25863 04:04:31.230991 tst mo_mt_call_osmux.py: using BVCI 25864 04:04:31.344300 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:31.356275 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:31.368193 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:31.380426 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:31.392616 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:04:31.405251 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:04:31.543304 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:04:31.685219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:32.217724 run create_hlr_db(pid=24148): Launched 04:04:32.371307 bus /sierra_2: Setting Powered False 04:04:33.432479 run create_hlr_db(pid=24148): Terminated: ok {rc=0} 04:04:33.854265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24150): Launched 04:04:34.156697 run osmo-hlr_10.42.42.2(pid=24151): Launched 04:04:34.271662 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:34.805065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24153): Launched 04:04:35.107486 run osmo-stp_10.42.42.5(pid=24154): Launched 04:04:35.222927 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:35.770582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24156): Launched 04:04:36.073480 run osmo-msc_10.42.42.6(pid=24157): Launched 04:04:36.242863 run osmo-stp_10.42.42.5(pid=24154): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24154)] 04:04:36.371293 run osmo-stp_10.42.42.5(pid=24154): stdout: | (launched: 2022-12-10_04:04:35.051899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:36.499546 run osmo-stp_10.42.42.5(pid=24154): stderr: | 20221210040435225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040435225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040435225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040435226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040435226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040435226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040435226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:36.625321 run osmo-stp_10.42.42.5(pid=24154): stdout: | (launched: 2022-12-10_04:04:35.051899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:36.745822 run osmo-stp_10.42.42.5(pid=24154): stderr: | 20221210040435225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040435225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040435225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040435226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040435226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040435226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040435226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:36.890120 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24154): Process ended prematurely: osmo-stp_10.42.42.5(pid=24154) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24154)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:04:36.899223 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:04:36.926200 run osmo-hlr_10.42.42.2(pid=24151): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24151)] 04:04:36.973606 run osmo-hlr_10.42.42.2(pid=24151): stdout: | (launched: 2022-12-10_04:04:34.101037) 04:04:37.022633 run osmo-hlr_10.42.42.2(pid=24151): stderr: | 20221210040434279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040434279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040434279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040434279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040434279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040434279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040434291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040434300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040434300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040434301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:37.090981 run osmo-msc_10.42.42.6(pid=24157): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24157)] 04:04:37.138507 run osmo-msc_10.42.42.6(pid=24157): stdout: | (launched: 2022-12-10_04:04:36.017724) 04:04:37.187445 run osmo-msc_10.42.42.6(pid=24157): stderr: | 20221210040436289 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040436289 DLGLOBAL DEBUG validating counter group 0x7fd8a1c43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040436289 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040436289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040436289 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040436290 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040436291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040436292 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040436292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040436292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:37.236931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24150): Terminating (SIGTERM) 04:04:37.276576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24153): Terminating (SIGTERM) 04:04:37.316040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24156): Terminating (SIGTERM) 04:04:37.355729 --- ParallelTerminationStrategy: PID 24150 died... 04:04:37.374605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24150): Terminated: ok {rc=0} 04:04:37.418462 --- ParallelTerminationStrategy: PID 24153 died... 04:04:37.436895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24153): Terminated: ok {rc=0} 04:04:37.481123 --- ParallelTerminationStrategy: PID 24156 died... 04:04:37.499528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24156): Terminated: ok {rc=0} 04:04:37.584778 bus /sierra_3: Setting Powered False 04:04:38.682818 bus /sierra_3: Setting Powered False 04:04:39.799278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:04:41.055161 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:04:41.061424 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:04:41.095732 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:04:41.123021 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:04:41.175760 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:04:41.210115 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:04:41.237313 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:04:41.789808 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:04:41.841272 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:41.852752 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:04:41.925853 tst mo_mt_call.py: using LAC 25864 04:04:42.053912 tst mo_mt_call.py: using RAC 109 04:04:42.180911 tst mo_mt_call.py: using CellId 25864 04:04:42.306979 tst mo_mt_call.py: using BVCI 25865 04:04:42.425063 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:42.436616 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:42.447969 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:42.459414 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:42.470892 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:42.482293 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:04:42.598733 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:04:42.715237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:43.184441 run create_hlr_db(pid=24162): Launched 04:04:43.300223 bus /sierra_2: Setting Powered False 04:04:44.363886 run create_hlr_db(pid=24162): Terminated: ok {rc=0} 04:04:44.796184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Launched 04:04:45.100231 run osmo-hlr_10.42.42.2(pid=24165): Launched 04:04:45.216216 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:45.738053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Launched 04:04:46.077677 run osmo-stp_10.42.42.5(pid=24168): Launched 04:04:46.285294 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:46.985746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24170): Launched 04:04:47.306530 run osmo-msc_10.42.42.6(pid=24171): Launched 04:04:47.476676 run osmo-stp_10.42.42.5(pid=24168): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] 04:04:47.605742 run osmo-stp_10.42.42.5(pid=24168): stdout: | (launched: 2022-12-10_04:04:46.011951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:47.734118 run osmo-stp_10.42.42.5(pid=24168): stderr: | 20221210040446323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040446324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040446324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040446324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040446325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040446325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040446325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:47.861351 run osmo-stp_10.42.42.5(pid=24168): stdout: | (launched: 2022-12-10_04:04:46.011951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:47.983255 run osmo-stp_10.42.42.5(pid=24168): stderr: | 20221210040446323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040446324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040446324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040446324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040446325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040446325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040446325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:48.128584 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24168): Process ended prematurely: osmo-stp_10.42.42.5(pid=24168) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:04:48.137886 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:04:48.165232 run osmo-hlr_10.42.42.2(pid=24165): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24165)] 04:04:48.212915 run osmo-hlr_10.42.42.2(pid=24165): stdout: | (launched: 2022-12-10_04:04:45.044585) 04:04:48.262081 run osmo-hlr_10.42.42.2(pid=24165): stderr: | 20221210040445220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040445220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040445220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040445220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040445220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040445221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040445235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040445244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040445244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040445244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:48.330642 run osmo-msc_10.42.42.6(pid=24171): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24171)] 04:04:48.378319 run osmo-msc_10.42.42.6(pid=24171): stdout: | (launched: 2022-12-10_04:04:47.250453) 04:04:48.427603 run osmo-msc_10.42.42.6(pid=24171): stderr: | 20221210040447525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040447525 DLGLOBAL DEBUG validating counter group 0x7f4412a7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040447525 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040447525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040447525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040447525 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040447529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040447530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040447530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040447530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:48.477357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Terminating (SIGTERM) 04:04:48.517040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Terminating (SIGTERM) 04:04:48.556724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24170): Terminating (SIGTERM) 04:04:48.596680 --- ParallelTerminationStrategy: PID 24164 died... 04:04:48.615609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Terminated: ok {rc=0} 04:04:48.659877 --- ParallelTerminationStrategy: PID 24167 died... 04:04:48.678492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Terminated: ok {rc=0} 04:04:48.722515 --- ParallelTerminationStrategy: PID 24170 died... 04:04:48.741080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24170): Terminated: ok {rc=0} 04:04:48.826733 bus /sierra_3: Setting Powered False 04:04:49.926353 bus /sierra_3: Setting Powered False 04:04:51.039496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:04:52.187674 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:52.199991 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:04:52.273066 tst mo_mt_call_osmux.py: using LAC 25865 04:04:52.398637 tst mo_mt_call_osmux.py: using RAC 110 04:04:52.525052 tst mo_mt_call_osmux.py: using CellId 25865 04:04:52.651605 tst mo_mt_call_osmux.py: using BVCI 25866 04:04:52.768380 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:52.780053 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:52.791498 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:52.802949 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:52.814601 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:04:52.826044 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:04:52.942691 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:04:53.062898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:53.531213 run create_hlr_db(pid=24174): Launched 04:04:53.648887 bus /sierra_2: Setting Powered False 04:04:54.709146 run create_hlr_db(pid=24174): Terminated: ok {rc=0} 04:04:55.148767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24176): Launched 04:04:55.470500 run osmo-hlr_10.42.42.2(pid=24177): Launched 04:04:55.593868 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:56.148610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24179): Launched 04:04:56.469337 run osmo-stp_10.42.42.5(pid=24180): Launched 04:04:56.593226 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:57.173825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24182): Launched 04:04:57.494917 run osmo-msc_10.42.42.6(pid=24183): Launched 04:04:57.674619 run osmo-stp_10.42.42.5(pid=24180): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24180)] 04:04:57.809607 run osmo-stp_10.42.42.5(pid=24180): stdout: | (launched: 2022-12-10_04:04:56.410956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:57.944885 run osmo-stp_10.42.42.5(pid=24180): stderr: | 20221210040456605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040456605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040456606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040456606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040456606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040456606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040456606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:58.079408 run osmo-stp_10.42.42.5(pid=24180): stdout: | (launched: 2022-12-10_04:04:56.410956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:58.207297 run osmo-stp_10.42.42.5(pid=24180): stderr: | 20221210040456605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040456605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040456606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040456606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040456606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040456606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040456606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:58.360122 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24180): Process ended prematurely: osmo-stp_10.42.42.5(pid=24180) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24180)] [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:04:58.369882 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:04:58.397760 run osmo-hlr_10.42.42.2(pid=24177): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24177)] 04:04:58.447363 run osmo-hlr_10.42.42.2(pid=24177): stdout: | (launched: 2022-12-10_04:04:55.411750) 04:04:58.498817 run osmo-hlr_10.42.42.2(pid=24177): stderr: | 20221210040455609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040455609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040455609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040455609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040455609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040455610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040455622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040455630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040455630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040455630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:58.570868 run osmo-msc_10.42.42.6(pid=24183): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24183)] 04:04:58.620659 run osmo-msc_10.42.42.6(pid=24183): stdout: | (launched: 2022-12-10_04:04:57.436122) 04:04:58.672119 run osmo-msc_10.42.42.6(pid=24183): stderr: | 20221210040457759 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040457759 DLGLOBAL DEBUG validating counter group 0x7f1591766c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040457759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040457760 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040457760 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040457760 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040457762 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040457762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040457762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040457762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:58.723678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24176): Terminating (SIGTERM) 04:04:58.765135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24179): Terminating (SIGTERM) 04:04:58.806456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24182): Terminating (SIGTERM) 04:04:58.847953 --- ParallelTerminationStrategy: PID 24176 died... 04:04:58.867590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24176): Terminated: ok {rc=0} 04:04:58.913454 --- ParallelTerminationStrategy: PID 24179 died... 04:04:58.932629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24179): Terminated: ok {rc=0} 04:04:58.977924 --- ParallelTerminationStrategy: PID 24182 died... 04:04:58.997102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24182): Terminated: ok {rc=0} 04:04:59.083348 bus /sierra_3: Setting Powered False 04:05:00.180847 bus /sierra_3: Setting Powered False 04:05:01.310925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 04:05:02.558596 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:02.562862 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:05:02.596157 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:05:02.623416 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 04:05:02.707668 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:05:02.740840 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:05:02.767365 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 04:05:03.351631 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 04:05:03.356466 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:03.367283 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:03.420725 tst emergency_mo_mt_call.py: using LAC 25866 04:05:03.537749 tst emergency_mo_mt_call.py: using RAC 111 04:05:03.660354 tst emergency_mo_mt_call.py: using CellId 25866 04:05:03.783568 tst emergency_mo_mt_call.py: using BVCI 25867 04:05:03.897713 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:03.909266 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:03.920406 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:03.931613 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:03.942705 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:03.953779 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:04.067141 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:04.180856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:04.641266 run create_hlr_db(pid=24191): Launched 04:05:04.756019 bus /sierra_2: Setting Powered False 04:05:05.815778 run create_hlr_db(pid=24191): Terminated: ok {rc=0} 04:05:06.248143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24193): Launched 04:05:06.564569 run osmo-hlr_10.42.42.2(pid=24194): Launched 04:05:06.686702 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:07.234479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24196): Launched 04:05:07.550314 run osmo-stp_10.42.42.5(pid=24197): Launched 04:05:07.681742 tst emergency_mo_mt_call.py: using MSISDN 7543 04:05:07.845419 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:08.414370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24199): Launched 04:05:08.730242 run osmo-msc_10.42.42.6(pid=24200): Launched 04:05:08.905734 run osmo-stp_10.42.42.5(pid=24197): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24197)] 04:05:09.038528 run osmo-stp_10.42.42.5(pid=24197): stdout: | (launched: 2022-12-10_04:05:07.491820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:09.171677 run osmo-stp_10.42.42.5(pid=24197): stderr: | 20221210040507686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040507686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040507686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040507687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040507687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040507687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040507687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:09.304097 run osmo-stp_10.42.42.5(pid=24197): stdout: | (launched: 2022-12-10_04:05:07.491820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:09.430257 run osmo-stp_10.42.42.5(pid=24197): stderr: | 20221210040507686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040507686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040507686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040507687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040507687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040507687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040507687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:09.581930 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24197): Process ended prematurely: osmo-stp_10.42.42.5(pid=24197) [trial-2369↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24197)] [trial-2369↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 04:05:09.590932 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 04:05:09.618067 run osmo-hlr_10.42.42.2(pid=24194): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24194)] 04:05:09.667632 run osmo-hlr_10.42.42.2(pid=24194): stdout: | (launched: 2022-12-10_04:05:06.506883) 04:05:09.718950 run osmo-hlr_10.42.42.2(pid=24194): stderr: | 20221210040506704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040506704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040506704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040506705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040506705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040506705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040506716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040506725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040506725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040506725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:09.790880 run osmo-msc_10.42.42.6(pid=24200): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24200)] 04:05:09.842741 run osmo-msc_10.42.42.6(pid=24200): stdout: | (launched: 2022-12-10_04:05:08.672399) 04:05:09.892562 run osmo-msc_10.42.42.6(pid=24200): stderr: | 20221210040508996 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040508996 DLGLOBAL DEBUG validating counter group 0x7f45d2089c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040508996 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040508996 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040508996 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040508997 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040508998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040508999 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040508999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040508999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:09.942557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24193): Terminating (SIGTERM) 04:05:09.983169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24196): Terminating (SIGTERM) 04:05:10.023710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24199): Terminating (SIGTERM) 04:05:10.064364 --- ParallelTerminationStrategy: PID 24193 died... 04:05:10.083232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24193): Terminated: ok {rc=0} 04:05:10.128662 --- ParallelTerminationStrategy: PID 24196 died... 04:05:10.147355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24196): Terminated: ok {rc=0} 04:05:10.192750 --- ParallelTerminationStrategy: PID 24199 died... 04:05:10.211366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24199): Terminated: ok {rc=0} 04:05:10.299354 bus /sierra_3: Setting Powered False 04:05:11.396475 bus /sierra_3: Setting Powered False 04:05:12.512523 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 04:05:13.600098 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:13.612506 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:13.665726 tst emergency_preemptive_call.py: using LAC 25867 04:05:13.782500 tst emergency_preemptive_call.py: using RAC 112 04:05:13.899980 tst emergency_preemptive_call.py: using CellId 25867 04:05:14.015079 tst emergency_preemptive_call.py: using BVCI 25868 04:05:14.124089 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:14.134887 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:14.145563 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:14.156627 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:14.167513 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:14.178361 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:14.293205 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:14.409731 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:14.526480 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:14.641107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:15.103979 run create_hlr_db(pid=24202): Launched 04:05:15.217482 bus /sierra_2: Setting Powered False 04:05:16.308659 run create_hlr_db(pid=24202): Terminated: ok {rc=0} 04:05:16.769973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24204): Launched 04:05:17.113728 run osmo-hlr_10.42.42.2(pid=24205): Launched 04:05:17.256229 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:17.808112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24207): Launched 04:05:18.125107 run osmo-stp_10.42.42.5(pid=24208): Launched 04:05:18.254868 tst emergency_preemptive_call.py: using MSISDN 7544 04:05:18.417287 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:18.986288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24210): Launched 04:05:19.302462 run osmo-msc_10.42.42.6(pid=24211): Launched 04:05:19.480082 run osmo-stp_10.42.42.5(pid=24208): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24208)] 04:05:19.615523 run osmo-stp_10.42.42.5(pid=24208): stdout: | (launched: 2022-12-10_04:05:18.067089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:19.750340 run osmo-stp_10.42.42.5(pid=24208): stderr: | 20221210040518259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040518259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040518259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040518260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040518260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040518260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040518260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:19.883401 run osmo-stp_10.42.42.5(pid=24208): stdout: | (launched: 2022-12-10_04:05:18.067089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:20.009759 run osmo-stp_10.42.42.5(pid=24208): stderr: | 20221210040518259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040518259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040518259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040518260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040518260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040518260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040518260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:20.160925 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24208): Process ended prematurely: osmo-stp_10.42.42.5(pid=24208) [trial-2369↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24208)] [trial-2369↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 04:05:20.170306 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 04:05:20.198008 run osmo-hlr_10.42.42.2(pid=24205): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24205)] 04:05:20.248125 run osmo-hlr_10.42.42.2(pid=24205): stdout: | (launched: 2022-12-10_04:05:17.044420) 04:05:20.299844 run osmo-hlr_10.42.42.2(pid=24205): stderr: | 20221210040517268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040517268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040517269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040517269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040517269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040517269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040517281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040517289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040517289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040517290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:20.372113 run osmo-msc_10.42.42.6(pid=24211): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24211)] 04:05:20.421935 run osmo-msc_10.42.42.6(pid=24211): stdout: | (launched: 2022-12-10_04:05:19.244511) 04:05:20.473372 run osmo-msc_10.42.42.6(pid=24211): stderr: | 20221210040519567 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210040519567 DLGLOBAL DEBUG validating counter group 0x7f6dda0bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210040519567 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210040519567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210040519568 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210040519568 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210040519570 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210040519570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210040519570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210040519570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:20.525310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24204): Terminating (SIGTERM) 04:05:20.566944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24207): Terminating (SIGTERM) 04:05:20.608333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24210): Terminating (SIGTERM) 04:05:20.649988 --- ParallelTerminationStrategy: PID 24204 died... 04:05:20.669821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24204): Terminated: ok {rc=0} 04:05:20.715822 --- ParallelTerminationStrategy: PID 24207 died... 04:05:20.735668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24207): Terminated: ok {rc=0} 04:05:20.781892 --- ParallelTerminationStrategy: PID 24210 died... 04:05:20.801583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24210): Terminated: ok {rc=0} 04:05:20.889374 bus /sierra_9: Setting Powered False 04:05:21.989722 bus /sierra_9: Setting Powered False 04:05:23.106156 bus /sierra_8: Setting Powered False 04:05:24.203563 bus /sierra_8: Setting Powered False 04:05:25.318401 bus /sierra_3: Setting Powered False 04:05:26.416846 bus /sierra_3: Setting Powered False 04:05:27.534131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 04:05:28.813241 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:28.817547 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:05:28.853166 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 04:05:28.892225 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 04:05:28.978586 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:05:29.012389 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 04:05:29.051018 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 04:05:29.641574 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 04:05:29.692807 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:29.703612 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:29.753077 tst cs_paging_gprs_active.py: using LAC 25868 04:05:29.872855 tst cs_paging_gprs_active.py: using RAC 113 04:05:29.991288 tst cs_paging_gprs_active.py: using CellId 25868 04:05:30.110079 tst cs_paging_gprs_active.py: using BVCI 25869 04:05:30.219770 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.230547 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.241099 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.251904 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.262583 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.273319 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.284182 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.295269 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:30.306175 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:30.424699 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:30.543605 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:05:30.763009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:05:31.113593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Launched 04:05:31.410352 run iperf3-srv_10.42.42.10(pid=24217): Launched 04:05:31.546836 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:05:31.770970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:05:32.105028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24218): Launched 04:05:32.395928 run iperf3-srv_10.42.42.10(pid=24219): Launched 04:05:32.517195 tst cs_paging_gprs_active.py:38: start network... 04:05:32.736862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:33.237414 run create_hlr_db(pid=24220): Launched 04:05:33.369829 bus /sierra_2: Setting Powered False 04:05:34.433897 run create_hlr_db(pid=24220): Terminated: ok {rc=0} 04:05:34.884214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24222): Launched 04:05:35.207803 run osmo-hlr_10.42.42.2(pid=24223): Launched 04:05:35.332171 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:35.889628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24225): Launched 04:05:36.211614 run osmo-stp_10.42.42.5(pid=24226): Launched 04:05:36.334661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:05:36.892130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24228): Launched 04:05:37.015526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:05:37.288662 run patchelf(pid=24229): Launched 04:05:37.468320 run osmo-stp_10.42.42.5(pid=24226): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24226)] 04:05:37.605854 run osmo-stp_10.42.42.5(pid=24226): stdout: | (launched: 2022-12-10_04:05:36.152771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:37.744891 run osmo-stp_10.42.42.5(pid=24226): stderr: | 20221210040536345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040536345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040536346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040536346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040536346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040536346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040536347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:37.884205 run osmo-stp_10.42.42.5(pid=24226): stdout: | (launched: 2022-12-10_04:05:36.152771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:38.016674 run osmo-stp_10.42.42.5(pid=24226): stderr: | 20221210040536345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040536345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040536346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040536346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040536346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040536346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040536347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:38.174048 run patchelf(pid=24229): Terminating (SIGINT) 04:05:38.355608 run patchelf(pid=24229): Terminated: ok {rc=0} 04:05:38.487129 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24226): Process ended prematurely: osmo-stp_10.42.42.5(pid=24226) [trial-2369↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24226)] [trial-2369↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 04:05:38.497690 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:05:38.526778 run osmo-hlr_10.42.42.2(pid=24223): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24223)] 04:05:38.576324 run osmo-hlr_10.42.42.2(pid=24223): stdout: | (launched: 2022-12-10_04:05:35.148541) 04:05:38.627624 run osmo-hlr_10.42.42.2(pid=24223): stderr: | 20221210040535348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040535348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040535348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040535348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040535348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040535348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040535360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040535369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040535369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040535369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:38.679330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Terminating (SIGTERM) 04:05:38.721101 run iperf3-srv_10.42.42.10(pid=24217): Terminating (SIGTERM) 04:05:38.762878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24218): Terminating (SIGTERM) 04:05:38.804567 run iperf3-srv_10.42.42.10(pid=24219): Terminating (SIGTERM) 04:05:38.846345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24222): Terminating (SIGTERM) 04:05:38.888261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24225): Terminating (SIGTERM) 04:05:38.929747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24228): Terminating (SIGTERM) 04:05:38.971526 --- ParallelTerminationStrategy: PID 24216 died... 04:05:38.991479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Terminated: ok {rc=0} 04:05:39.037948 --- ParallelTerminationStrategy: PID 24217 died... 04:05:39.057613 run iperf3-srv_10.42.42.10(pid=24217): Terminated {rc=256} 04:05:39.103182 --- ParallelTerminationStrategy: PID 24218 died... 04:05:39.122745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24218): Terminated: ok {rc=0} 04:05:39.168345 --- ParallelTerminationStrategy: PID 24219 died... 04:05:39.187692 run iperf3-srv_10.42.42.10(pid=24219): Terminated {rc=256} 04:05:39.233655 --- ParallelTerminationStrategy: PID 24222 died... 04:05:39.253081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24222): Terminated: ok {rc=0} 04:05:39.298665 --- ParallelTerminationStrategy: PID 24225 died... 04:05:39.318105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24225): Terminated: ok {rc=0} 04:05:39.363703 --- ParallelTerminationStrategy: PID 24228 died... 04:05:39.383254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24228): Terminated: ok {rc=0} 04:05:39.470012 bus /gobi_0: Setting Powered False 04:05:40.567139 bus /gobi_0: Setting Powered False 04:05:41.683115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 04:05:42.824629 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:42.836046 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:42.887798 tst iperf3.py: using LAC 25869 04:05:43.006130 tst iperf3.py: using RAC 114 04:05:43.123784 tst iperf3.py: using CellId 25869 04:05:43.242987 tst iperf3.py: using BVCI 25870 04:05:43.352428 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.363209 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.373825 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.384507 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.395280 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.406051 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.416873 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.427595 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:43.438389 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:43.554259 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:05:43.758772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:05:44.064021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24230): Launched 04:05:44.328299 run iperf3-srv_10.42.42.10(pid=24231): Launched 04:05:44.441837 tst iperf3.py:8: start network... 04:05:44.645794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:45.115097 run create_hlr_db(pid=24232): Launched 04:05:45.230664 bus /gobi_6: Setting Powered False 04:05:46.307380 run create_hlr_db(pid=24232): Terminated: ok {rc=0} 04:05:46.775027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24234): Launched 04:05:47.133685 run osmo-hlr_10.42.42.2(pid=24235): Launched 04:05:47.331136 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:47.854562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24237): Launched 04:05:48.158615 run osmo-stp_10.42.42.5(pid=24238): Launched 04:05:48.274180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:05:48.798988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24240): Launched 04:05:48.915361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:05:49.172389 run patchelf(pid=24241): Launched 04:05:49.341236 run osmo-stp_10.42.42.5(pid=24238): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24238)] 04:05:49.470086 run osmo-stp_10.42.42.5(pid=24238): stdout: | (launched: 2022-12-10_04:05:48.102774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:49.600738 run osmo-stp_10.42.42.5(pid=24238): stderr: | 20221210040548274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040548274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040548274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040548275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040548275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040548275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040548275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:49.731591 run osmo-stp_10.42.42.5(pid=24238): stdout: | (launched: 2022-12-10_04:05:48.102774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:49.856654 run osmo-stp_10.42.42.5(pid=24238): stderr: | 20221210040548274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040548274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040548274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040548275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040548275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040548275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040548275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:50.004249 run patchelf(pid=24241): Terminating (SIGINT) 04:05:50.175081 run patchelf(pid=24241): Terminated: ok {rc=0} 04:05:50.298377 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24238): Process ended prematurely: osmo-stp_10.42.42.5(pid=24238) [trial-2369↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24238)] [trial-2369↪gprs:trx-sysmocell5000↪iperf3.py:8] 04:05:50.308083 tst iperf3.py:8: Test FAILED (7.5 sec) 04:05:50.335741 run osmo-hlr_10.42.42.2(pid=24235): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24235)] 04:05:50.383533 run osmo-hlr_10.42.42.2(pid=24235): stdout: | (launched: 2022-12-10_04:05:47.062666) 04:05:50.432940 run osmo-hlr_10.42.42.2(pid=24235): stderr: | 20221210040547280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040547280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040547280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040547280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040547280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040547280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040547297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040547307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040547307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040547307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:50.482604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24230): Terminating (SIGTERM) 04:05:50.522320 run iperf3-srv_10.42.42.10(pid=24231): Terminating (SIGTERM) 04:05:50.561950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24234): Terminating (SIGTERM) 04:05:50.601781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24237): Terminating (SIGTERM) 04:05:50.641521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24240): Terminating (SIGTERM) 04:05:50.681526 --- ParallelTerminationStrategy: PID 24230 died... 04:05:50.700492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24230): Terminated: ok {rc=0} 04:05:50.745619 --- ParallelTerminationStrategy: PID 24231 died... 04:05:50.764296 run iperf3-srv_10.42.42.10(pid=24231): Terminated {rc=256} 04:05:50.808604 --- ParallelTerminationStrategy: PID 24234 died... 04:05:50.827280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24234): Terminated: ok {rc=0} 04:05:50.871276 --- ParallelTerminationStrategy: PID 24237 died... 04:05:50.889974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24237): Terminated: ok {rc=0} 04:05:50.934721 --- ParallelTerminationStrategy: PID 24240 died... 04:05:50.953522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24240): Terminated: ok {rc=0} 04:05:51.039565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 04:05:52.187782 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.199228 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:52.252263 tst iperf3m4.py: using LAC 25870 04:05:52.370970 tst iperf3m4.py: using RAC 115 04:05:52.488313 tst iperf3m4.py: using CellId 25870 04:05:52.606054 tst iperf3m4.py: using BVCI 25871 04:05:52.717886 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.728615 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.739230 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.750182 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.761076 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.771876 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.782844 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.793844 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:05:52.805439 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:52.920197 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:53.039942 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:53.156458 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:53.274311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:05:53.493828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:05:53.819259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Launched 04:05:54.101131 run iperf3-srv_10.42.42.10(pid=24243): Launched 04:05:54.222183 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:05:54.440325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:05:54.765314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Launched 04:05:55.046492 run iperf3-srv_10.42.42.10(pid=24245): Launched 04:05:55.167450 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:05:55.386484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:05:55.711943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Launched 04:05:55.993442 run iperf3-srv_10.42.42.10(pid=24247): Launched 04:05:56.114305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:05:56.332777 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:05:56.658215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Launched 04:05:56.939391 run iperf3-srv_10.42.42.10(pid=24249): Launched 04:05:57.060419 tst iperf3m4.py:8: start network... 04:05:57.279262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:57.782888 run create_hlr_db(pid=24250): Launched 04:05:57.913798 bus /gobi_6: Setting Powered False 04:05:58.977624 run create_hlr_db(pid=24250): Terminated: ok {rc=0} 04:05:59.425960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24252): Launched 04:05:59.749677 run osmo-hlr_10.42.42.2(pid=24253): Launched 04:05:59.871731 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:00.431442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24255): Launched 04:06:00.755651 run osmo-stp_10.42.42.5(pid=24256): Launched 04:06:00.879049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:01.648786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24258): Launched 04:06:01.782989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:02.057724 run patchelf(pid=24259): Launched 04:06:02.243598 run osmo-stp_10.42.42.5(pid=24256): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24256)] 04:06:02.376776 run osmo-stp_10.42.42.5(pid=24256): stdout: | (launched: 2022-12-10_04:06:00.696438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:02.508329 run osmo-stp_10.42.42.5(pid=24256): stderr: | 20221210040601012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040601012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040601017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040601017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040601018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040601018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040601018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:02.640420 run osmo-stp_10.42.42.5(pid=24256): stdout: | (launched: 2022-12-10_04:06:00.696438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:02.765943 run osmo-stp_10.42.42.5(pid=24256): stderr: | 20221210040601012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040601012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040601017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040601017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040601018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040601018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040601018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:02.914909 run patchelf(pid=24259): Terminating (SIGINT) 04:06:03.086388 run patchelf(pid=24259): Terminated: ok {rc=0} 04:06:03.210347 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24256): Process ended prematurely: osmo-stp_10.42.42.5(pid=24256) [trial-2369↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24256)] [trial-2369↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 04:06:03.220483 tst iperf3m4.py:8: Test FAILED (11.1 sec) 04:06:03.249265 run osmo-hlr_10.42.42.2(pid=24253): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24253)] 04:06:03.297417 run osmo-hlr_10.42.42.2(pid=24253): stdout: | (launched: 2022-12-10_04:05:59.690579) 04:06:03.347295 run osmo-hlr_10.42.42.2(pid=24253): stderr: | 20221210040559888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040559888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040559888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040559888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040559889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040559889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040559901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040559909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040559909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040559910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:03.397513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminating (SIGTERM) 04:06:03.437638 run iperf3-srv_10.42.42.10(pid=24243): Terminating (SIGTERM) 04:06:03.478365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminating (SIGTERM) 04:06:03.518724 run iperf3-srv_10.42.42.10(pid=24245): Terminating (SIGTERM) 04:06:03.558829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Terminating (SIGTERM) 04:06:03.599280 run iperf3-srv_10.42.42.10(pid=24247): Terminating (SIGTERM) 04:06:03.639633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Terminating (SIGTERM) 04:06:03.679558 run iperf3-srv_10.42.42.10(pid=24249): Terminating (SIGTERM) 04:06:03.719588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24252): Terminating (SIGTERM) 04:06:03.759324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24255): Terminating (SIGTERM) 04:06:03.799288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24258): Terminating (SIGTERM) 04:06:03.839761 --- ParallelTerminationStrategy: PID 24242 died... 04:06:03.858648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminated: ok {rc=0} 04:06:03.903501 --- ParallelTerminationStrategy: PID 24243 died... 04:06:03.922295 run iperf3-srv_10.42.42.10(pid=24243): Terminated {rc=256} 04:06:03.967343 --- ParallelTerminationStrategy: PID 24244 died... 04:06:03.986348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminated: ok {rc=0} 04:06:04.031216 --- ParallelTerminationStrategy: PID 24245 died... 04:06:04.049940 run iperf3-srv_10.42.42.10(pid=24245): Terminated {rc=256} 04:06:04.094535 --- ParallelTerminationStrategy: PID 24246 died... 04:06:04.113437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Terminated: ok {rc=0} 04:06:04.158247 --- ParallelTerminationStrategy: PID 24247 died... 04:06:04.177098 run iperf3-srv_10.42.42.10(pid=24247): Terminated {rc=256} 04:06:04.222055 --- ParallelTerminationStrategy: PID 24248 died... 04:06:04.240897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Terminated: ok {rc=0} 04:06:04.285664 --- ParallelTerminationStrategy: PID 24249 died... 04:06:04.304483 run iperf3-srv_10.42.42.10(pid=24249): Terminated {rc=256} 04:06:04.349351 --- ParallelTerminationStrategy: PID 24252 died... 04:06:04.368173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24252): Terminated: ok {rc=0} 04:06:04.413099 --- ParallelTerminationStrategy: PID 24255 died... 04:06:04.431808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24255): Terminated: ok {rc=0} 04:06:04.476841 --- ParallelTerminationStrategy: PID 24258 died... 04:06:04.496109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24258): Terminated: ok {rc=0} 04:06:04.585550 bus /gobi_4: Setting Powered False 04:06:05.684624 bus /gobi_4: Setting Powered False 04:06:06.802504 bus /gobi_1: Setting Powered False 04:06:07.900907 bus /gobi_1: Setting Powered False 04:06:09.017287 bus /gobi_0: Setting Powered False 04:06:10.114830 bus /gobi_0: Setting Powered False 04:06:11.234656 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 04:06:12.337330 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.348741 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:12.398202 tst ping.py: using LAC 25871 04:06:12.513254 tst ping.py: using RAC 116 04:06:12.632002 tst ping.py: using CellId 25871 04:06:12.745756 tst ping.py: using BVCI 25872 04:06:12.851556 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.862314 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.872873 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.883696 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.894431 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.905108 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.915832 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:12.926820 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:13.043070 tst ping.py:19: start network... 04:06:13.253989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:13.735797 run create_hlr_db(pid=24260): Launched 04:06:13.862572 bus /gobi_6: Setting Powered False 04:06:14.924134 run create_hlr_db(pid=24260): Terminated: ok {rc=0} 04:06:15.341539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24262): Launched 04:06:15.633644 run osmo-hlr_10.42.42.2(pid=24263): Launched 04:06:15.748703 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:16.400781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24265): Launched 04:06:16.741708 run osmo-stp_10.42.42.5(pid=24266): Launched 04:06:16.894283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:17.576919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24268): Launched 04:06:17.696360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:17.959700 run patchelf(pid=24269): Launched 04:06:18.133986 run osmo-stp_10.42.42.5(pid=24266): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24266)] 04:06:18.266705 run osmo-stp_10.42.42.5(pid=24266): stdout: | (launched: 2022-12-10_04:06:16.674667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:18.400902 run osmo-stp_10.42.42.5(pid=24266): stderr: | 20221210040617006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040617006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040617006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040617006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040617007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040617007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040617007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:18.535017 run osmo-stp_10.42.42.5(pid=24266): stdout: | (launched: 2022-12-10_04:06:16.674667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:18.663674 run osmo-stp_10.42.42.5(pid=24266): stderr: | 20221210040617006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040617006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040617006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040617006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040617007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040617007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040617007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:18.815433 run patchelf(pid=24269): Terminating (SIGINT) 04:06:18.989694 run patchelf(pid=24269): Terminated: ok {rc=0} 04:06:19.115748 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24266): Process ended prematurely: osmo-stp_10.42.42.5(pid=24266) [trial-2369↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24266)] [trial-2369↪gprs:trx-sysmocell5000↪ping.py:22] 04:06:19.125413 tst ping.py:22: Test FAILED (6.8 sec) 04:06:19.153696 run osmo-hlr_10.42.42.2(pid=24263): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24263)] 04:06:19.203454 run osmo-hlr_10.42.42.2(pid=24263): stdout: | (launched: 2022-12-10_04:06:15.580141) 04:06:19.254950 run osmo-hlr_10.42.42.2(pid=24263): stderr: | 20221210040615756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040615756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040615756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040615756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040615756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040615756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040615768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040615778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040615778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040615778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:19.306967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24262): Terminating (SIGTERM) 04:06:19.349045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24265): Terminating (SIGTERM) 04:06:19.390960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24268): Terminating (SIGTERM) 04:06:19.433133 --- ParallelTerminationStrategy: PID 24262 died... 04:06:19.453260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24262): Terminated: ok {rc=0} 04:06:19.499960 --- ParallelTerminationStrategy: PID 24265 died... 04:06:19.519714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24265): Terminated: ok {rc=0} 04:06:19.566665 --- ParallelTerminationStrategy: PID 24268 died... 04:06:19.586333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24268): Terminated: ok {rc=0} 04:06:19.674200 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 04:06:20.762161 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:20.777517 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:20.828194 tst ping_idle_ping.py: using LAC 25872 04:06:20.952619 tst ping_idle_ping.py: using RAC 117 04:06:21.077168 tst ping_idle_ping.py: using CellId 25872 04:06:21.199929 tst ping_idle_ping.py: using BVCI 25873 04:06:21.308060 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:21.319029 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:21.329925 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:21.340649 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:21.351679 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:21.362748 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:21.373842 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:21.384407 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:21.495912 tst ping_idle_ping.py:24: start network... 04:06:21.692661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:22.150097 run create_hlr_db(pid=24270): Launched 04:06:22.261149 bus /gobi_6: Setting Powered False 04:06:23.320250 run create_hlr_db(pid=24270): Terminated: ok {rc=0} 04:06:23.729457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24272): Launched 04:06:24.022757 run osmo-hlr_10.42.42.2(pid=24273): Launched 04:06:24.135736 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:24.655718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24275): Launched 04:06:24.948414 run osmo-stp_10.42.42.5(pid=24276): Launched 04:06:25.060277 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:25.566253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24278): Launched 04:06:25.678234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:25.926143 run patchelf(pid=24279): Launched 04:06:26.089379 run osmo-stp_10.42.42.5(pid=24276): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24276)] 04:06:26.214149 run osmo-stp_10.42.42.5(pid=24276): stdout: | (launched: 2022-12-10_04:06:24.894704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:26.339914 run osmo-stp_10.42.42.5(pid=24276): stderr: | 20221210040625066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040625066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040625066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040625066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040625067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040625067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040625067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:26.465934 run osmo-stp_10.42.42.5(pid=24276): stdout: | (launched: 2022-12-10_04:06:24.894704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:26.586188 run osmo-stp_10.42.42.5(pid=24276): stderr: | 20221210040625066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040625066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040625066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040625066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040625067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040625067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040625067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:26.728233 run patchelf(pid=24279): Terminating (SIGINT) 04:06:26.893470 run patchelf(pid=24279): Terminated: ok {rc=0} 04:06:27.012280 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24276): Process ended prematurely: osmo-stp_10.42.42.5(pid=24276) [trial-2369↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24276)] [trial-2369↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 04:06:27.021328 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:06:27.048280 run osmo-hlr_10.42.42.2(pid=24273): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24273)] 04:06:27.095526 run osmo-hlr_10.42.42.2(pid=24273): stdout: | (launched: 2022-12-10_04:06:23.968765) 04:06:27.144421 run osmo-hlr_10.42.42.2(pid=24273): stderr: | 20221210040624145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040624145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040624145 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040624145 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040624145 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040624145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040624156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040624165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040624165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040624165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:27.193900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24272): Terminating (SIGTERM) 04:06:27.233562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24275): Terminating (SIGTERM) 04:06:27.273055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24278): Terminating (SIGTERM) 04:06:27.313613 --- ParallelTerminationStrategy: PID 24272 died... 04:06:27.332531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24272): Terminated: ok {rc=0} 04:06:27.376659 --- ParallelTerminationStrategy: PID 24275 died... 04:06:27.395086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24275): Terminated: ok {rc=0} 04:06:27.438985 --- ParallelTerminationStrategy: PID 24278 died... 04:06:27.457716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24278): Terminated: ok {rc=0} 04:06:27.541398 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 04:06:28.846445 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:06:28.853415 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:06:28.888530 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:06:28.928184 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:06:29.016497 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:06:29.050860 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:06:29.090308 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:06:29.687955 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:06:29.739384 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:29.750939 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:06:29.802724 tst cs_paging_gprs_active.py: using LAC 25873 04:06:29.930602 tst cs_paging_gprs_active.py: using RAC 118 04:06:30.054857 tst cs_paging_gprs_active.py: using CellId 25873 04:06:30.178148 tst cs_paging_gprs_active.py: using BVCI 25874 04:06:30.293267 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.304845 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.316447 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.327880 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.339306 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.350858 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.362396 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.374007 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:30.385729 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:06:30.501853 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:06:30.615750 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:06:30.816543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:31.181623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24283): Launched 04:06:31.521734 run iperf3-srv_10.42.42.10(pid=24284): Launched 04:06:31.648832 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:06:31.858907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:32.184607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24285): Launched 04:06:32.451592 run iperf3-srv_10.42.42.10(pid=24286): Launched 04:06:32.564067 tst cs_paging_gprs_active.py:38: start network... 04:06:32.765415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:33.227557 run create_hlr_db(pid=24287): Launched 04:06:33.343366 bus /gobi_6: Setting Powered False 04:06:34.402571 run create_hlr_db(pid=24287): Terminated: ok {rc=0} 04:06:34.837938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24289): Launched 04:06:35.155035 run osmo-hlr_10.42.42.2(pid=24290): Launched 04:06:35.276613 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:35.827824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24292): Launched 04:06:36.145189 run osmo-stp_10.42.42.5(pid=24293): Launched 04:06:36.266892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:36.815513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24295): Launched 04:06:36.937155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:37.204791 run patchelf(pid=24296): Launched 04:06:37.381150 run osmo-stp_10.42.42.5(pid=24293): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24293)] 04:06:37.515865 run osmo-stp_10.42.42.5(pid=24293): stdout: | (launched: 2022-12-10_04:06:36.087441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:37.652912 run osmo-stp_10.42.42.5(pid=24293): stderr: | 20221210040636281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040636281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040636281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040636281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040636282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040636282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040636282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:37.789328 run osmo-stp_10.42.42.5(pid=24293): stdout: | (launched: 2022-12-10_04:06:36.087441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:37.919301 run osmo-stp_10.42.42.5(pid=24293): stderr: | 20221210040636281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040636281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040636281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040636281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040636282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040636282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040636282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:38.073579 run patchelf(pid=24296): Terminating (SIGINT) 04:06:38.252054 run patchelf(pid=24296): Terminated: ok {rc=0} 04:06:38.380601 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24293): Process ended prematurely: osmo-stp_10.42.42.5(pid=24293) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24293)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:06:38.390972 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:06:38.419170 run osmo-hlr_10.42.42.2(pid=24290): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24290)] 04:06:38.468228 run osmo-hlr_10.42.42.2(pid=24290): stdout: | (launched: 2022-12-10_04:06:35.097487) 04:06:38.519135 run osmo-hlr_10.42.42.2(pid=24290): stderr: | 20221210040635294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040635294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040635294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040635294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040635294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040635294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040635307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040635317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040635317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040635317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:38.570992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24283): Terminating (SIGTERM) 04:06:38.612574 run iperf3-srv_10.42.42.10(pid=24284): Terminating (SIGTERM) 04:06:38.653855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24285): Terminating (SIGTERM) 04:06:38.695468 run iperf3-srv_10.42.42.10(pid=24286): Terminating (SIGTERM) 04:06:38.736672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24289): Terminating (SIGTERM) 04:06:38.778245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24292): Terminating (SIGTERM) 04:06:38.819703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24295): Terminating (SIGTERM) 04:06:38.861432 --- ParallelTerminationStrategy: PID 24283 died... 04:06:38.881233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24283): Terminated: ok {rc=0} 04:06:38.927393 --- ParallelTerminationStrategy: PID 24284 died... 04:06:38.946776 run iperf3-srv_10.42.42.10(pid=24284): Terminated {rc=256} 04:06:38.992432 --- ParallelTerminationStrategy: PID 24285 died... 04:06:39.011733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24285): Terminated: ok {rc=0} 04:06:39.057316 --- ParallelTerminationStrategy: PID 24286 died... 04:06:39.076757 run iperf3-srv_10.42.42.10(pid=24286): Terminated {rc=256} 04:06:39.122402 --- ParallelTerminationStrategy: PID 24289 died... 04:06:39.141799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24289): Terminated: ok {rc=0} 04:06:39.187219 --- ParallelTerminationStrategy: PID 24292 died... 04:06:39.206565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24292): Terminated: ok {rc=0} 04:06:39.252065 --- ParallelTerminationStrategy: PID 24295 died... 04:06:39.271241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24295): Terminated: ok {rc=0} 04:06:39.357889 bus /gobi_0: Setting Powered False 04:06:40.455195 bus /gobi_0: Setting Powered False 04:06:41.569060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:06:42.715615 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:42.727598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:06:42.780503 tst iperf3.py: using LAC 25874 04:06:42.906510 tst iperf3.py: using RAC 119 04:06:43.032624 tst iperf3.py: using CellId 25874 04:06:43.154038 tst iperf3.py: using BVCI 25875 04:06:43.267866 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.279322 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.290757 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.301999 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.313272 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.324440 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.335767 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.346895 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:43.358341 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:06:43.474404 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:06:43.687725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:44.003031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24297): Launched 04:06:44.276722 run iperf3-srv_10.42.42.10(pid=24298): Launched 04:06:44.395151 tst iperf3.py:8: start network... 04:06:44.608865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:45.096126 run create_hlr_db(pid=24299): Launched 04:06:45.223488 bus /gobi_6: Setting Powered False 04:06:46.317752 run create_hlr_db(pid=24299): Terminated: ok {rc=0} 04:06:46.771307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Launched 04:06:47.176481 run osmo-hlr_10.42.42.2(pid=24302): Launched 04:06:47.330441 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:47.858270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24304): Launched 04:06:48.154311 run osmo-stp_10.42.42.5(pid=24305): Launched 04:06:48.267392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:48.778257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24307): Launched 04:06:48.892113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:49.142579 run patchelf(pid=24308): Launched 04:06:49.307468 run osmo-stp_10.42.42.5(pid=24305): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24305)] 04:06:49.433970 run osmo-stp_10.42.42.5(pid=24305): stdout: | (launched: 2022-12-10_04:06:48.100404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:49.562112 run osmo-stp_10.42.42.5(pid=24305): stderr: | 20221210040648270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040648270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040648271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040648271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040648271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040648272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040648272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:49.689955 run osmo-stp_10.42.42.5(pid=24305): stdout: | (launched: 2022-12-10_04:06:48.100404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:49.811616 run osmo-stp_10.42.42.5(pid=24305): stderr: | 20221210040648270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040648270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040648271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040648271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040648271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040648272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040648272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:49.955942 run patchelf(pid=24308): Terminating (SIGINT) 04:06:50.122294 run patchelf(pid=24308): Terminated: ok {rc=0} 04:06:50.242407 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24305): Process ended prematurely: osmo-stp_10.42.42.5(pid=24305) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24305)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 04:06:50.252050 tst iperf3.py:8: Test FAILED (7.6 sec) 04:06:50.279298 run osmo-hlr_10.42.42.2(pid=24302): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24302)] 04:06:50.327080 run osmo-hlr_10.42.42.2(pid=24302): stdout: | (launched: 2022-12-10_04:06:47.100869) 04:06:50.376369 run osmo-hlr_10.42.42.2(pid=24302): stderr: | 20221210040647384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040647384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040647384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040647384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040647384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040647384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040647398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040647406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040647406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040647406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:50.426103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24297): Terminating (SIGTERM) 04:06:50.466012 run iperf3-srv_10.42.42.10(pid=24298): Terminating (SIGTERM) 04:06:50.505567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Terminating (SIGTERM) 04:06:50.545145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24304): Terminating (SIGTERM) 04:06:50.584622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24307): Terminating (SIGTERM) 04:06:50.624200 --- ParallelTerminationStrategy: PID 24297 died... 04:06:50.643045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24297): Terminated: ok {rc=0} 04:06:50.687378 --- ParallelTerminationStrategy: PID 24298 died... 04:06:50.705857 run iperf3-srv_10.42.42.10(pid=24298): Terminated {rc=256} 04:06:50.749965 --- ParallelTerminationStrategy: PID 24301 died... 04:06:50.768348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Terminated: ok {rc=0} 04:06:50.811997 --- ParallelTerminationStrategy: PID 24304 died... 04:06:50.830418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24304): Terminated: ok {rc=0} 04:06:50.873926 --- ParallelTerminationStrategy: PID 24307 died... 04:06:50.892504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24307): Terminated: ok {rc=0} 04:06:50.978645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:06:52.124856 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.136303 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:06:52.188290 tst iperf3m4.py: using LAC 25875 04:06:52.304897 tst iperf3m4.py: using RAC 120 04:06:52.421369 tst iperf3m4.py: using CellId 25875 04:06:52.538803 tst iperf3m4.py: using BVCI 25876 04:06:52.647301 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.658352 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.669151 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.680192 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.691055 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.702076 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.713182 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.724096 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:06:52.735314 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:06:52.854321 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:06:52.969453 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:06:53.085617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:06:53.197934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:06:53.395737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:53.690279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24309): Launched 04:06:53.945202 run iperf3-srv_10.42.42.10(pid=24310): Launched 04:06:54.055499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:06:54.253227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:54.548671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24311): Launched 04:06:54.804054 run iperf3-srv_10.42.42.10(pid=24312): Launched 04:06:54.914082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:06:55.111097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:55.405855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24313): Launched 04:06:55.661292 run iperf3-srv_10.42.42.10(pid=24314): Launched 04:06:55.771791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:06:55.969461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:56.264860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24315): Launched 04:06:56.521562 run iperf3-srv_10.42.42.10(pid=24316): Launched 04:06:56.631731 tst iperf3m4.py:8: start network... 04:06:56.829070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:57.282094 run create_hlr_db(pid=24317): Launched 04:06:57.392931 bus /gobi_6: Setting Powered False 04:06:58.451793 run create_hlr_db(pid=24317): Terminated: ok {rc=0} 04:06:58.860342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24319): Launched 04:06:59.152384 run osmo-hlr_10.42.42.2(pid=24320): Launched 04:06:59.264464 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:59.783571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24322): Launched 04:07:00.076573 run osmo-stp_10.42.42.5(pid=24323): Launched 04:07:00.188695 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:00.695719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24325): Launched 04:07:00.808468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:01.074134 run patchelf(pid=24326): Launched 04:07:01.259371 run osmo-stp_10.42.42.5(pid=24323): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24323)] 04:07:01.397100 run osmo-stp_10.42.42.5(pid=24323): stdout: | (launched: 2022-12-10_04:07:00.023082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:01.531681 run osmo-stp_10.42.42.5(pid=24323): stderr: | 20221210040700190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040700190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040700190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040700191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040700191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040700191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040700191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:01.662424 run osmo-stp_10.42.42.5(pid=24323): stdout: | (launched: 2022-12-10_04:07:00.023082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:01.787000 run osmo-stp_10.42.42.5(pid=24323): stderr: | 20221210040700190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040700190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040700190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040700191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040700191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040700191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040700191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:01.934725 run patchelf(pid=24326): Terminating (SIGINT) 04:07:02.105338 run patchelf(pid=24326): Terminated: ok {rc=0} 04:07:02.228249 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24323): Process ended prematurely: osmo-stp_10.42.42.5(pid=24323) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24323)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 04:07:02.239648 tst iperf3m4.py:8: Test FAILED (10.1 sec) 04:07:02.267614 run osmo-hlr_10.42.42.2(pid=24320): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24320)] 04:07:02.314834 run osmo-hlr_10.42.42.2(pid=24320): stdout: | (launched: 2022-12-10_04:06:59.099119) 04:07:02.363562 run osmo-hlr_10.42.42.2(pid=24320): stderr: | 20221210040659272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040659272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040659272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040659272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040659272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040659272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040659284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040659293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040659293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040659293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:02.413035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24309): Terminating (SIGTERM) 04:07:02.452434 run iperf3-srv_10.42.42.10(pid=24310): Terminating (SIGTERM) 04:07:02.491575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24311): Terminating (SIGTERM) 04:07:02.530945 run iperf3-srv_10.42.42.10(pid=24312): Terminating (SIGTERM) 04:07:02.569912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24313): Terminating (SIGTERM) 04:07:02.609205 run iperf3-srv_10.42.42.10(pid=24314): Terminating (SIGTERM) 04:07:02.648193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24315): Terminating (SIGTERM) 04:07:02.687432 run iperf3-srv_10.42.42.10(pid=24316): Terminating (SIGTERM) 04:07:02.727038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24319): Terminating (SIGTERM) 04:07:02.766272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24322): Terminating (SIGTERM) 04:07:02.805586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24325): Terminating (SIGTERM) 04:07:02.845143 --- ParallelTerminationStrategy: PID 24309 died... 04:07:02.863934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24309): Terminated: ok {rc=0} 04:07:02.908390 --- ParallelTerminationStrategy: PID 24310 died... 04:07:02.926834 run iperf3-srv_10.42.42.10(pid=24310): Terminated {rc=256} 04:07:02.970675 --- ParallelTerminationStrategy: PID 24311 died... 04:07:02.989091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24311): Terminated: ok {rc=0} 04:07:03.032602 --- ParallelTerminationStrategy: PID 24312 died... 04:07:03.050924 run iperf3-srv_10.42.42.10(pid=24312): Terminated {rc=256} 04:07:03.094525 --- ParallelTerminationStrategy: PID 24313 died... 04:07:03.112909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24313): Terminated: ok {rc=0} 04:07:03.156412 --- ParallelTerminationStrategy: PID 24314 died... 04:07:03.174800 run iperf3-srv_10.42.42.10(pid=24314): Terminated {rc=256} 04:07:03.218462 --- ParallelTerminationStrategy: PID 24315 died... 04:07:03.236812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24315): Terminated: ok {rc=0} 04:07:03.280321 --- ParallelTerminationStrategy: PID 24316 died... 04:07:03.298708 run iperf3-srv_10.42.42.10(pid=24316): Terminated {rc=256} 04:07:03.343517 --- ParallelTerminationStrategy: PID 24319 died... 04:07:03.361973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24319): Terminated: ok {rc=0} 04:07:03.405773 --- ParallelTerminationStrategy: PID 24322 died... 04:07:03.424344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24322): Terminated: ok {rc=0} 04:07:03.468031 --- ParallelTerminationStrategy: PID 24325 died... 04:07:03.486525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24325): Terminated: ok {rc=0} 04:07:03.571771 bus /gobi_4: Setting Powered False 04:07:04.669938 bus /gobi_4: Setting Powered False 04:07:05.785068 bus /gobi_1: Setting Powered False 04:07:06.881959 bus /gobi_1: Setting Powered False 04:07:07.994716 bus /gobi_0: Setting Powered False 04:07:09.091348 bus /gobi_0: Setting Powered False 04:07:10.206828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 04:07:11.307659 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.319127 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:11.369626 tst ping.py: using LAC 25876 04:07:11.493162 tst ping.py: using RAC 121 04:07:11.614657 tst ping.py: using CellId 25876 04:07:11.737468 tst ping.py: using BVCI 25877 04:07:11.849292 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.860914 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.872452 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.884688 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.896446 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.908119 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.919975 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:11.931730 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:12.046441 tst ping.py:19: start network... 04:07:12.239381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:12.683253 run create_hlr_db(pid=24329): Launched 04:07:12.792338 bus /gobi_6: Setting Powered False 04:07:13.850593 run create_hlr_db(pid=24329): Terminated: ok {rc=0} 04:07:14.270437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24331): Launched 04:07:14.576729 run osmo-hlr_10.42.42.2(pid=24332): Launched 04:07:14.694602 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:15.230058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24334): Launched 04:07:15.534811 run osmo-stp_10.42.42.5(pid=24335): Launched 04:07:15.652491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:16.215120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24337): Launched 04:07:16.342615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:16.611075 run patchelf(pid=24338): Launched 04:07:16.790118 run osmo-stp_10.42.42.5(pid=24335): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24335)] 04:07:16.922727 run osmo-stp_10.42.42.5(pid=24335): stdout: | (launched: 2022-12-10_04:07:15.479433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:17.057116 run osmo-stp_10.42.42.5(pid=24335): stderr: | 20221210040715672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040715672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040715672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040715672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040715673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040715673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040715673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:17.192028 run osmo-stp_10.42.42.5(pid=24335): stdout: | (launched: 2022-12-10_04:07:15.479433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:17.319291 run osmo-stp_10.42.42.5(pid=24335): stderr: | 20221210040715672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040715672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040715672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040715672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040715673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040715673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040715673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:17.468752 run patchelf(pid=24338): Terminating (SIGINT) 04:07:17.641479 run patchelf(pid=24338): Terminated: ok {rc=0} 04:07:17.765573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24335): Process ended prematurely: osmo-stp_10.42.42.5(pid=24335) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24335)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 04:07:17.775494 tst ping.py:22: Test FAILED (6.5 sec) 04:07:17.803710 run osmo-hlr_10.42.42.2(pid=24332): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24332)] 04:07:17.853796 run osmo-hlr_10.42.42.2(pid=24332): stdout: | (launched: 2022-12-10_04:07:14.521212) 04:07:17.904461 run osmo-hlr_10.42.42.2(pid=24332): stderr: | 20221210040714718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040714718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040714718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040714718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040714719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040714719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040714731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040714739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040714739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040714739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:17.955507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24331): Terminating (SIGTERM) 04:07:17.996676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24334): Terminating (SIGTERM) 04:07:18.037950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24337): Terminating (SIGTERM) 04:07:18.079182 --- ParallelTerminationStrategy: PID 24331 died... 04:07:18.099011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24331): Terminated: ok {rc=0} 04:07:18.144431 --- ParallelTerminationStrategy: PID 24334 died... 04:07:18.163729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24334): Terminated: ok {rc=0} 04:07:18.209057 --- ParallelTerminationStrategy: PID 24337 died... 04:07:18.228246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24337): Terminated: ok {rc=0} 04:07:18.314303 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:07:19.401976 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:19.414115 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:19.465384 tst ping_idle_ping.py: using LAC 25877 04:07:19.581335 tst ping_idle_ping.py: using RAC 122 04:07:19.697196 tst ping_idle_ping.py: using CellId 25877 04:07:19.818646 tst ping_idle_ping.py: using BVCI 25878 04:07:19.929718 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:19.941375 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:19.952852 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:19.964271 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:19.975688 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:19.987080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:19.998578 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:20.009851 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:20.124545 tst ping_idle_ping.py:24: start network... 04:07:20.331807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:20.811977 run create_hlr_db(pid=24339): Launched 04:07:20.937214 bus /gobi_6: Setting Powered False 04:07:21.999365 run create_hlr_db(pid=24339): Terminated: ok {rc=0} 04:07:22.414300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Launched 04:07:22.703954 run osmo-hlr_10.42.42.2(pid=24342): Launched 04:07:22.814771 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:23.320785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Launched 04:07:23.608924 run osmo-stp_10.42.42.5(pid=24345): Launched 04:07:23.719321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:24.219407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24347): Launched 04:07:24.330130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:24.574686 run patchelf(pid=24348): Launched 04:07:24.735980 run osmo-stp_10.42.42.5(pid=24345): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] 04:07:24.859350 run osmo-stp_10.42.42.5(pid=24345): stdout: | (launched: 2022-12-10_04:07:23.556298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:24.984283 run osmo-stp_10.42.42.5(pid=24345): stderr: | 20221210040723723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040723723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040723723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040723724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040723726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040723726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040723726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:25.108869 run osmo-stp_10.42.42.5(pid=24345): stdout: | (launched: 2022-12-10_04:07:23.556298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:25.228197 run osmo-stp_10.42.42.5(pid=24345): stderr: | 20221210040723723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040723723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040723723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040723724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040723726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040723726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040723726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:25.369465 run patchelf(pid=24348): Terminating (SIGINT) 04:07:25.532035 run patchelf(pid=24348): Terminated: ok {rc=0} 04:07:25.649296 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24345): Process ended prematurely: osmo-stp_10.42.42.5(pid=24345) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 04:07:25.658192 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 04:07:25.685211 run osmo-hlr_10.42.42.2(pid=24342): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24342)] 04:07:25.732299 run osmo-hlr_10.42.42.2(pid=24342): stdout: | (launched: 2022-12-10_04:07:22.651350) 04:07:25.781088 run osmo-hlr_10.42.42.2(pid=24342): stderr: | 20221210040722826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040722826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040722826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040722826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040722827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040722827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040722839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040722848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040722848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040722848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:25.830055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Terminating (SIGTERM) 04:07:25.869415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Terminating (SIGTERM) 04:07:25.908788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24347): Terminating (SIGTERM) 04:07:25.948470 --- ParallelTerminationStrategy: PID 24341 died... 04:07:25.967409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Terminated: ok {rc=0} 04:07:26.011231 --- ParallelTerminationStrategy: PID 24344 died... 04:07:26.029779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Terminated: ok {rc=0} 04:07:26.073876 --- ParallelTerminationStrategy: PID 24347 died... 04:07:26.092395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24347): Terminated: ok {rc=0} 04:07:26.174524 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:07:27.476490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:07:27.482584 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:07:27.515737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:07:27.553737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:07:27.639921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:07:27.673025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:07:27.710771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:07:28.306963 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:07:28.354639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.365565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:07:28.436713 tst cs_paging_gprs_active.py: using LAC 25878 04:07:28.550261 tst cs_paging_gprs_active.py: using RAC 123 04:07:28.663340 tst cs_paging_gprs_active.py: using CellId 25878 04:07:28.785865 tst cs_paging_gprs_active.py: using BVCI 25879 04:07:28.898856 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.910488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.921992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.933536 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.945390 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.956532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.967904 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.979082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:28.990597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:07:29.105806 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:07:29.220057 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:07:29.417751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:29.712740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24352): Launched 04:07:29.966961 run iperf3-srv_10.42.42.10(pid=24353): Launched 04:07:30.077098 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:07:30.273784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:30.566926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24354): Launched 04:07:30.822140 run iperf3-srv_10.42.42.10(pid=24355): Launched 04:07:30.968424 tst cs_paging_gprs_active.py:38: start network... 04:07:31.224614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:31.771903 run create_hlr_db(pid=24356): Launched 04:07:31.954204 bus /gobi_6: Setting Powered False 04:07:33.012879 run create_hlr_db(pid=24356): Terminated: ok {rc=0} 04:07:33.500115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24358): Launched 04:07:33.797803 run osmo-hlr_10.42.42.2(pid=24359): Launched 04:07:33.909485 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:34.423560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24361): Launched 04:07:34.716454 run osmo-stp_10.42.42.5(pid=24362): Launched 04:07:34.828363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:35.334892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24364): Launched 04:07:35.447072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:35.695040 run patchelf(pid=24365): Launched 04:07:35.858360 run osmo-stp_10.42.42.5(pid=24362): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24362)] 04:07:35.985189 run osmo-stp_10.42.42.5(pid=24362): stdout: | (launched: 2022-12-10_04:07:34.662612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:36.111849 run osmo-stp_10.42.42.5(pid=24362): stderr: | 20221210040734834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040734834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040734834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040734835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040734835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040734835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040734835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:36.238508 run osmo-stp_10.42.42.5(pid=24362): stdout: | (launched: 2022-12-10_04:07:34.662612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:36.358876 run osmo-stp_10.42.42.5(pid=24362): stderr: | 20221210040734834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040734834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040734834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040734835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040734835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040734835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040734835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:36.501741 run patchelf(pid=24365): Terminating (SIGINT) 04:07:36.667351 run patchelf(pid=24365): Terminated: ok {rc=0} 04:07:36.787573 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24362): Process ended prematurely: osmo-stp_10.42.42.5(pid=24362) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24362)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:07:36.797299 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:07:36.824534 run osmo-hlr_10.42.42.2(pid=24359): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24359)] 04:07:36.871806 run osmo-hlr_10.42.42.2(pid=24359): stdout: | (launched: 2022-12-10_04:07:33.744540) 04:07:36.920320 run osmo-hlr_10.42.42.2(pid=24359): stderr: | 20221210040733918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040733918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040733918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040733918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040733918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040733918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040733929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040733938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040733939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040733939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:36.969203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24352): Terminating (SIGTERM) 04:07:37.008069 run iperf3-srv_10.42.42.10(pid=24353): Terminating (SIGTERM) 04:07:37.047213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24354): Terminating (SIGTERM) 04:07:37.086257 run iperf3-srv_10.42.42.10(pid=24355): Terminating (SIGTERM) 04:07:37.125289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24358): Terminating (SIGTERM) 04:07:37.164264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24361): Terminating (SIGTERM) 04:07:37.203378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24364): Terminating (SIGTERM) 04:07:37.242649 --- ParallelTerminationStrategy: PID 24352 died... 04:07:37.261379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24352): Terminated: ok {rc=0} 04:07:37.304731 --- ParallelTerminationStrategy: PID 24353 died... 04:07:37.322862 run iperf3-srv_10.42.42.10(pid=24353): Terminated {rc=256} 04:07:37.366098 --- ParallelTerminationStrategy: PID 24354 died... 04:07:37.384141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24354): Terminated: ok {rc=0} 04:07:37.427157 --- ParallelTerminationStrategy: PID 24355 died... 04:07:37.445165 run iperf3-srv_10.42.42.10(pid=24355): Terminated {rc=256} 04:07:37.488197 --- ParallelTerminationStrategy: PID 24358 died... 04:07:37.506216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24358): Terminated: ok {rc=0} 04:07:37.549535 --- ParallelTerminationStrategy: PID 24361 died... 04:07:37.567720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24361): Terminated: ok {rc=0} 04:07:37.611048 --- ParallelTerminationStrategy: PID 24364 died... 04:07:37.629172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24364): Terminated: ok {rc=0} 04:07:37.712549 bus /gobi_0: Setting Powered False 04:07:38.810767 bus /gobi_0: Setting Powered False 04:07:39.924877 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:07:41.069159 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.080675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:07:41.152931 tst iperf3.py: using LAC 25879 04:07:41.269915 tst iperf3.py: using RAC 124 04:07:41.393640 tst iperf3.py: using CellId 25879 04:07:41.515660 tst iperf3.py: using BVCI 25880 04:07:41.629604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.641422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.652685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.663993 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.675160 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.686383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.697705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.708736 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:41.720062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:07:41.836497 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:07:42.035548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:42.329477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24369): Launched 04:07:42.584426 run iperf3-srv_10.42.42.10(pid=24370): Launched 04:07:42.694715 tst iperf3.py:8: start network... 04:07:42.892243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:43.345461 run create_hlr_db(pid=24371): Launched 04:07:43.458850 bus /gobi_6: Setting Powered False 04:07:44.517533 run create_hlr_db(pid=24371): Terminated: ok {rc=0} 04:07:44.945558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24373): Launched 04:07:45.257312 run osmo-hlr_10.42.42.2(pid=24374): Launched 04:07:45.376499 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:45.930439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24376): Launched 04:07:46.273706 run osmo-stp_10.42.42.5(pid=24377): Launched 04:07:46.514058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:47.091620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24379): Launched 04:07:47.218518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:47.483095 run patchelf(pid=24380): Launched 04:07:47.657635 run osmo-stp_10.42.42.5(pid=24377): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24377)] 04:07:47.790829 run osmo-stp_10.42.42.5(pid=24377): stdout: | (launched: 2022-12-10_04:07:46.200139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:47.925779 run osmo-stp_10.42.42.5(pid=24377): stderr: | 20221210040746399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040746400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040746400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040746400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040746401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040746401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040746401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:48.060734 run osmo-stp_10.42.42.5(pid=24377): stdout: | (launched: 2022-12-10_04:07:46.200139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:48.189468 run osmo-stp_10.42.42.5(pid=24377): stderr: | 20221210040746399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040746400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040746400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040746400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040746401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040746401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040746401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:48.341948 run patchelf(pid=24380): Terminating (SIGINT) 04:07:48.517907 run patchelf(pid=24380): Terminated: ok {rc=0} 04:07:48.645717 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24377): Process ended prematurely: osmo-stp_10.42.42.5(pid=24377) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24377)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 04:07:48.655998 tst iperf3.py:8: Test FAILED (7.6 sec) 04:07:48.684287 run osmo-hlr_10.42.42.2(pid=24374): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24374)] 04:07:48.733543 run osmo-hlr_10.42.42.2(pid=24374): stdout: | (launched: 2022-12-10_04:07:45.201267) 04:07:48.784769 run osmo-hlr_10.42.42.2(pid=24374): stderr: | 20221210040745396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040745396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040745396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040745397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040745397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040745397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040745413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040745423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040745423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040745423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:48.836636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24369): Terminating (SIGTERM) 04:07:48.877712 run iperf3-srv_10.42.42.10(pid=24370): Terminating (SIGTERM) 04:07:48.918977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24373): Terminating (SIGTERM) 04:07:48.960196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24376): Terminating (SIGTERM) 04:07:49.001494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24379): Terminating (SIGTERM) 04:07:49.042980 --- ParallelTerminationStrategy: PID 24369 died... 04:07:49.062721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24369): Terminated: ok {rc=0} 04:07:49.108492 --- ParallelTerminationStrategy: PID 24370 died... 04:07:49.127832 run iperf3-srv_10.42.42.10(pid=24370): Terminated {rc=256} 04:07:49.173247 --- ParallelTerminationStrategy: PID 24373 died... 04:07:49.192537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24373): Terminated: ok {rc=0} 04:07:49.238219 --- ParallelTerminationStrategy: PID 24376 died... 04:07:49.257667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24376): Terminated: ok {rc=0} 04:07:49.303779 --- ParallelTerminationStrategy: PID 24379 died... 04:07:49.323251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24379): Terminated: ok {rc=0} 04:07:49.409698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:07:50.556476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:50.568719 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:07:50.640862 tst iperf3m4.py: using LAC 25880 04:07:50.758254 tst iperf3m4.py: using RAC 125 04:07:50.873361 tst iperf3m4.py: using CellId 25880 04:07:50.989988 tst iperf3m4.py: using BVCI 25881 04:07:51.098174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.109490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.120391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.131473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.142636 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.153865 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.165193 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.176592 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:07:51.187938 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:07:51.305529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:07:51.421088 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:07:51.538147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:07:51.655224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:07:51.853724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:52.149598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24381): Launched 04:07:52.405676 run iperf3-srv_10.42.42.10(pid=24382): Launched 04:07:52.516063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:07:52.714414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:53.010873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24383): Launched 04:07:53.266793 run iperf3-srv_10.42.42.10(pid=24384): Launched 04:07:53.377268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:07:53.575473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:53.870975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24385): Launched 04:07:54.126653 run iperf3-srv_10.42.42.10(pid=24386): Launched 04:07:54.236596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:07:54.434112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:54.729437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24387): Launched 04:07:54.985750 run iperf3-srv_10.42.42.10(pid=24388): Launched 04:07:55.095407 tst iperf3m4.py:8: start network... 04:07:55.292753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:55.746069 run create_hlr_db(pid=24389): Launched 04:07:55.857374 bus /gobi_6: Setting Powered False 04:07:56.916404 run create_hlr_db(pid=24389): Terminated: ok {rc=0} 04:07:57.346519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24391): Launched 04:07:57.660186 run osmo-hlr_10.42.42.2(pid=24392): Launched 04:07:57.781631 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:58.321591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24394): Launched 04:07:58.633082 run osmo-stp_10.42.42.5(pid=24395): Launched 04:07:58.753058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:59.295590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24397): Launched 04:07:59.415592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:59.680459 run patchelf(pid=24398): Launched 04:07:59.854682 run osmo-stp_10.42.42.5(pid=24395): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24395)] 04:07:59.987596 run osmo-stp_10.42.42.5(pid=24395): stdout: | (launched: 2022-12-10_04:07:58.576385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:00.122521 run osmo-stp_10.42.42.5(pid=24395): stderr: | 20221210040758764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040758764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040758764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040758765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040758765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040758765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040758766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:00.257157 run osmo-stp_10.42.42.5(pid=24395): stdout: | (launched: 2022-12-10_04:07:58.576385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:00.385820 run osmo-stp_10.42.42.5(pid=24395): stderr: | 20221210040758764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040758764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040758764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040758765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040758765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040758765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040758766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:00.537989 run patchelf(pid=24398): Terminating (SIGINT) 04:08:00.714430 run patchelf(pid=24398): Terminated: ok {rc=0} 04:08:00.854533 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24395): Process ended prematurely: osmo-stp_10.42.42.5(pid=24395) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24395)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:08:00.865699 tst iperf3m4.py:8: Test FAILED (10.3 sec) 04:08:00.903009 run osmo-hlr_10.42.42.2(pid=24392): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24392)] 04:08:00.954561 run osmo-hlr_10.42.42.2(pid=24392): stdout: | (launched: 2022-12-10_04:07:57.603552) 04:08:01.007779 run osmo-hlr_10.42.42.2(pid=24392): stderr: | 20221210040757800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040757801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040757801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040757801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040757801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040757801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040757814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040757822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040757822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040757822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:01.068804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24381): Terminating (SIGTERM) 04:08:01.124272 run iperf3-srv_10.42.42.10(pid=24382): Terminating (SIGTERM) 04:08:01.182371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24383): Terminating (SIGTERM) 04:08:01.238048 run iperf3-srv_10.42.42.10(pid=24384): Terminating (SIGTERM) 04:08:01.295653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24385): Terminating (SIGTERM) 04:08:01.350412 run iperf3-srv_10.42.42.10(pid=24386): Terminating (SIGTERM) 04:08:01.407788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24387): Terminating (SIGTERM) 04:08:01.462944 run iperf3-srv_10.42.42.10(pid=24388): Terminating (SIGTERM) 04:08:01.515298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24391): Terminating (SIGTERM) 04:08:01.561486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24394): Terminating (SIGTERM) 04:08:01.603911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24397): Terminating (SIGTERM) 04:08:01.646278 --- ParallelTerminationStrategy: PID 24381 died... 04:08:01.666254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24381): Terminated: ok {rc=0} 04:08:01.713263 --- ParallelTerminationStrategy: PID 24382 died... 04:08:01.733197 run iperf3-srv_10.42.42.10(pid=24382): Terminated {rc=256} 04:08:01.779532 --- ParallelTerminationStrategy: PID 24383 died... 04:08:01.799308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24383): Terminated: ok {rc=0} 04:08:01.846597 --- ParallelTerminationStrategy: PID 24384 died... 04:08:01.866396 run iperf3-srv_10.42.42.10(pid=24384): Terminated {rc=256} 04:08:01.913119 --- ParallelTerminationStrategy: PID 24385 died... 04:08:01.933108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24385): Terminated: ok {rc=0} 04:08:01.979895 --- ParallelTerminationStrategy: PID 24386 died... 04:08:01.999820 run iperf3-srv_10.42.42.10(pid=24386): Terminated {rc=256} 04:08:02.045995 --- ParallelTerminationStrategy: PID 24387 died... 04:08:02.065852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24387): Terminated: ok {rc=0} 04:08:02.112776 --- ParallelTerminationStrategy: PID 24388 died... 04:08:02.132851 run iperf3-srv_10.42.42.10(pid=24388): Terminated {rc=256} 04:08:02.179415 --- ParallelTerminationStrategy: PID 24391 died... 04:08:02.199271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24391): Terminated: ok {rc=0} 04:08:02.245979 --- ParallelTerminationStrategy: PID 24394 died... 04:08:02.265694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24394): Terminated: ok {rc=0} 04:08:02.312190 --- ParallelTerminationStrategy: PID 24397 died... 04:08:02.332122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24397): Terminated: ok {rc=0} 04:08:02.418879 bus /gobi_4: Setting Powered False 04:08:03.516058 bus /gobi_4: Setting Powered False 04:08:04.630222 bus /gobi_1: Setting Powered False 04:08:05.727222 bus /gobi_1: Setting Powered False 04:08:06.841285 bus /gobi_0: Setting Powered False 04:08:07.938101 bus /gobi_0: Setting Powered False 04:08:09.056706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:08:10.157943 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.169405 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:10.240148 tst ping.py: using LAC 25881 04:08:10.357286 tst ping.py: using RAC 126 04:08:10.473683 tst ping.py: using CellId 25881 04:08:10.587302 tst ping.py: using BVCI 25882 04:08:10.691743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.702741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.713611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.724608 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.735482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.746484 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.757628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.768696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:10.881528 tst ping.py:19: start network... 04:08:11.075186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:11.520760 run create_hlr_db(pid=24399): Launched 04:08:11.630222 bus /gobi_6: Setting Powered False 04:08:12.687772 run create_hlr_db(pid=24399): Terminated: ok {rc=0} 04:08:13.108595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24401): Launched 04:08:13.414774 run osmo-hlr_10.42.42.2(pid=24402): Launched 04:08:13.531900 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:14.062710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24404): Launched 04:08:14.368213 run osmo-stp_10.42.42.5(pid=24405): Launched 04:08:14.485170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:15.017260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24407): Launched 04:08:15.134559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:15.393841 run patchelf(pid=24408): Launched 04:08:15.564596 run osmo-stp_10.42.42.5(pid=24405): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24405)] 04:08:15.695528 run osmo-stp_10.42.42.5(pid=24405): stdout: | (launched: 2022-12-10_04:08:14.312778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:15.827608 run osmo-stp_10.42.42.5(pid=24405): stderr: | 20221210040814503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040814503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040814503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040814504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040814504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040814504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040814504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:15.971641 run osmo-stp_10.42.42.5(pid=24405): stdout: | (launched: 2022-12-10_04:08:14.312778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:16.100500 run osmo-stp_10.42.42.5(pid=24405): stderr: | 20221210040814503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040814503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040814503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040814504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040814504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040814504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040814504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:16.274411 run patchelf(pid=24408): Terminating (SIGINT) 04:08:16.473931 run patchelf(pid=24408): Terminated: ok {rc=0} 04:08:16.608621 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24405): Process ended prematurely: osmo-stp_10.42.42.5(pid=24405) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24405)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 04:08:16.619428 tst ping.py:22: Test FAILED (6.5 sec) 04:08:16.651917 run osmo-hlr_10.42.42.2(pid=24402): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24402)] 04:08:16.712372 run osmo-hlr_10.42.42.2(pid=24402): stdout: | (launched: 2022-12-10_04:08:13.359652) 04:08:16.765313 run osmo-hlr_10.42.42.2(pid=24402): stderr: | 20221210040813555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040813555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040813555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040813555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040813555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040813555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040813567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040813576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040813576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040813576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:16.818676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24401): Terminating (SIGTERM) 04:08:16.861289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24404): Terminating (SIGTERM) 04:08:16.904527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24407): Terminating (SIGTERM) 04:08:16.948858 --- ParallelTerminationStrategy: PID 24401 died... 04:08:16.969229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24401): Terminated: ok {rc=0} 04:08:17.016314 --- ParallelTerminationStrategy: PID 24404 died... 04:08:17.038851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24404): Terminated: ok {rc=0} 04:08:17.091598 --- ParallelTerminationStrategy: PID 24407 died... 04:08:17.112151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24407): Terminated: ok {rc=0} 04:08:17.220128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:08:18.343510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:18.360545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:18.453945 tst ping_idle_ping.py: using LAC 25882 04:08:18.604846 tst ping_idle_ping.py: using RAC 127 04:08:18.753418 tst ping_idle_ping.py: using CellId 25882 04:08:18.890701 tst ping_idle_ping.py: using BVCI 25883 04:08:19.046276 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.067261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.080402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.092466 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.115509 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.131276 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.145204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:19.158420 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:19.275620 tst ping_idle_ping.py:24: start network... 04:08:19.477219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:19.956365 run create_hlr_db(pid=24679): Launched 04:08:20.108010 bus /gobi_6: Setting Powered False 04:08:21.167061 run create_hlr_db(pid=24679): Terminated: ok {rc=0} 04:08:21.591504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24683): Launched 04:08:21.905312 run osmo-hlr_10.42.42.2(pid=24684): Launched 04:08:22.137694 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:22.838499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24686): Launched 04:08:23.149829 run osmo-stp_10.42.42.5(pid=24687): Launched 04:08:23.372632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:24.043460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24689): Launched 04:08:24.169166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:24.437820 run patchelf(pid=24690): Launched 04:08:24.613131 run osmo-stp_10.42.42.5(pid=24687): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24687)] 04:08:24.740937 run osmo-stp_10.42.42.5(pid=24687): stdout: | (launched: 2022-12-10_04:08:23.090187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:24.870888 run osmo-stp_10.42.42.5(pid=24687): stderr: | 20221210040823412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040823412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040823412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040823412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040823413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040823413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040823413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:25.000311 run osmo-stp_10.42.42.5(pid=24687): stdout: | (launched: 2022-12-10_04:08:23.090187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:25.122955 run osmo-stp_10.42.42.5(pid=24687): stderr: | 20221210040823412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040823412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040823412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040823412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040823413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040823413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040823413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:25.269176 run patchelf(pid=24690): Terminating (SIGINT) 04:08:25.436234 run patchelf(pid=24690): Terminated: ok {rc=0} 04:08:25.558557 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24687): Process ended prematurely: osmo-stp_10.42.42.5(pid=24687) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24687)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:08:25.568719 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 04:08:25.598922 run osmo-hlr_10.42.42.2(pid=24684): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24684)] 04:08:25.648703 run osmo-hlr_10.42.42.2(pid=24684): stdout: | (launched: 2022-12-10_04:08:21.846467) 04:08:25.700579 run osmo-hlr_10.42.42.2(pid=24684): stderr: | 20221210040822186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040822186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040822186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040822186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040822186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040822186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040822211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040822219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040822219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040822219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:25.753665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24683): Terminating (SIGTERM) 04:08:25.797452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24686): Terminating (SIGTERM) 04:08:25.842613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24689): Terminating (SIGTERM) 04:08:25.887239 --- ParallelTerminationStrategy: PID 24683 died... 04:08:25.907068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24683): Terminated: ok {rc=0} 04:08:25.955570 --- ParallelTerminationStrategy: PID 24686 died... 04:08:25.975012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24686): Terminated: ok {rc=0} 04:08:26.022133 --- ParallelTerminationStrategy: PID 24689 died... 04:08:26.041630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24689): Terminated: ok {rc=0} 04:08:26.128170 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:08:27.437421 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:08:27.444369 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:08:27.483259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:08:27.524644 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:08:27.613183 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:08:27.648611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:08:27.689226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:08:28.282873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:08:28.334486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.346836 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:08:28.420568 tst cs_paging_gprs_active.py: using LAC 25883 04:08:28.541168 tst cs_paging_gprs_active.py: using RAC 128 04:08:28.661054 tst cs_paging_gprs_active.py: using CellId 25883 04:08:28.781162 tst cs_paging_gprs_active.py: using BVCI 25884 04:08:28.892704 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.904828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.916655 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.930793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.943749 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.955690 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.968750 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.982603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:28.995668 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:08:29.113845 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:08:29.233391 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:08:29.438079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:29.762866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24694): Launched 04:08:30.042302 run iperf3-srv_10.42.42.10(pid=24695): Launched 04:08:30.169546 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:08:30.374664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:30.686618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24696): Launched 04:08:31.042395 run iperf3-srv_10.42.42.10(pid=24697): Launched 04:08:31.196156 tst cs_paging_gprs_active.py:38: start network... 04:08:31.412409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:31.923253 run create_hlr_db(pid=24698): Launched 04:08:32.112882 bus /gobi_6: Setting Powered False 04:08:33.174195 run create_hlr_db(pid=24698): Terminated: ok {rc=0} 04:08:33.617322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24700): Launched 04:08:33.944192 run osmo-hlr_10.42.42.2(pid=24701): Launched 04:08:34.183681 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:34.903640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24703): Launched 04:08:35.233681 run osmo-stp_10.42.42.5(pid=24704): Launched 04:08:35.471203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:36.161867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24706): Launched 04:08:36.282537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:36.549669 run patchelf(pid=24707): Launched 04:08:36.734824 run osmo-stp_10.42.42.5(pid=24704): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24704)] 04:08:36.866782 run osmo-stp_10.42.42.5(pid=24704): stdout: | (launched: 2022-12-10_04:08:35.163785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:36.999975 run osmo-stp_10.42.42.5(pid=24704): stderr: | 20221210040835489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040835489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040835490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040835490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040835490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040835491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040835491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:37.132903 run osmo-stp_10.42.42.5(pid=24704): stdout: | (launched: 2022-12-10_04:08:35.163785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:37.259353 run osmo-stp_10.42.42.5(pid=24704): stderr: | 20221210040835489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040835489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040835490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040835490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040835490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040835491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040835491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:37.407739 run patchelf(pid=24707): Terminating (SIGINT) 04:08:37.582916 run patchelf(pid=24707): Terminated: ok {rc=0} 04:08:37.708783 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24704): Process ended prematurely: osmo-stp_10.42.42.5(pid=24704) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24704)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:08:37.719870 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 04:08:37.750656 run osmo-hlr_10.42.42.2(pid=24701): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24701)] 04:08:37.802416 run osmo-hlr_10.42.42.2(pid=24701): stdout: | (launched: 2022-12-10_04:08:33.880094) 04:08:37.856129 run osmo-hlr_10.42.42.2(pid=24701): stderr: | 20221210040834227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040834227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040834227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040834227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040834227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040834227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040834247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040834265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040834265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040834265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:37.908746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24694): Terminating (SIGTERM) 04:08:37.951817 run iperf3-srv_10.42.42.10(pid=24695): Terminating (SIGTERM) 04:08:37.996836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24696): Terminating (SIGTERM) 04:08:38.040542 run iperf3-srv_10.42.42.10(pid=24697): Terminating (SIGTERM) 04:08:38.085612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24700): Terminating (SIGTERM) 04:08:38.128516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24703): Terminating (SIGTERM) 04:08:38.173460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24706): Terminating (SIGTERM) 04:08:38.218590 --- ParallelTerminationStrategy: PID 24694 died... 04:08:38.238824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24694): Terminated: ok {rc=0} 04:08:38.287973 --- ParallelTerminationStrategy: PID 24695 died... 04:08:38.307580 run iperf3-srv_10.42.42.10(pid=24695): Terminated {rc=256} 04:08:38.354830 --- ParallelTerminationStrategy: PID 24696 died... 04:08:38.374546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24696): Terminated: ok {rc=0} 04:08:38.423014 --- ParallelTerminationStrategy: PID 24697 died... 04:08:38.442930 run iperf3-srv_10.42.42.10(pid=24697): Terminated {rc=256} 04:08:38.490020 --- ParallelTerminationStrategy: PID 24700 died... 04:08:38.509592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24700): Terminated: ok {rc=0} 04:08:38.557075 --- ParallelTerminationStrategy: PID 24703 died... 04:08:38.576816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24703): Terminated: ok {rc=0} 04:08:38.625075 --- ParallelTerminationStrategy: PID 24706 died... 04:08:38.644529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24706): Terminated: ok {rc=0} 04:08:38.732708 bus /gobi_0: Setting Powered False 04:08:39.833579 bus /gobi_0: Setting Powered False 04:08:40.946996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:08:42.092574 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.104645 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:08:42.179864 tst iperf3.py: using LAC 25884 04:08:42.302519 tst iperf3.py: using RAC 129 04:08:42.426309 tst iperf3.py: using CellId 25884 04:08:42.548719 tst iperf3.py: using BVCI 25885 04:08:42.662051 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.673522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.684615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.695862 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.707016 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.718338 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.729693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.740776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:42.752087 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:08:42.869471 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:08:43.081410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:43.396174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24709): Launched 04:08:43.669254 run iperf3-srv_10.42.42.10(pid=24710): Launched 04:08:43.786774 tst iperf3.py:8: start network... 04:08:43.998187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:44.482027 run create_hlr_db(pid=24711): Launched 04:08:44.608272 bus /gobi_6: Setting Powered False 04:08:45.671482 run create_hlr_db(pid=24711): Terminated: ok {rc=0} 04:08:46.114856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24713): Launched 04:08:46.446339 run osmo-hlr_10.42.42.2(pid=24714): Launched 04:08:46.734671 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:47.425998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24716): Launched 04:08:47.738412 run osmo-stp_10.42.42.5(pid=24717): Launched 04:08:47.857310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:48.395736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24719): Launched 04:08:48.515439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:48.779173 run patchelf(pid=24720): Launched 04:08:48.952542 run osmo-stp_10.42.42.5(pid=24717): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24717)] 04:08:49.085638 run osmo-stp_10.42.42.5(pid=24717): stdout: | (launched: 2022-12-10_04:08:47.682163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:49.220581 run osmo-stp_10.42.42.5(pid=24717): stderr: | 20221210040847875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040847875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040847875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040847876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040847876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040847876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040847876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:49.356466 run osmo-stp_10.42.42.5(pid=24717): stdout: | (launched: 2022-12-10_04:08:47.682163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:49.485080 run osmo-stp_10.42.42.5(pid=24717): stderr: | 20221210040847875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040847875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040847875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040847876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040847876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040847876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040847876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:49.637603 run patchelf(pid=24720): Terminating (SIGINT) 04:08:49.813589 run patchelf(pid=24720): Terminated: ok {rc=0} 04:08:49.940542 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24717): Process ended prematurely: osmo-stp_10.42.42.5(pid=24717) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24717)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 04:08:49.950881 tst iperf3.py:8: Test FAILED (7.9 sec) 04:08:49.979541 run osmo-hlr_10.42.42.2(pid=24714): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24714)] 04:08:50.028652 run osmo-hlr_10.42.42.2(pid=24714): stdout: | (launched: 2022-12-10_04:08:46.379360) 04:08:50.079761 run osmo-hlr_10.42.42.2(pid=24714): stderr: | 20221210040846712 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040846712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040846712 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040846712 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040846713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040846713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040846729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040846750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040846750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040846750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:50.131135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24709): Terminating (SIGTERM) 04:08:50.172523 run iperf3-srv_10.42.42.10(pid=24710): Terminating (SIGTERM) 04:08:50.214028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24713): Terminating (SIGTERM) 04:08:50.255577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24716): Terminating (SIGTERM) 04:08:50.296918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24719): Terminating (SIGTERM) 04:08:50.339109 --- ParallelTerminationStrategy: PID 24709 died... 04:08:50.358846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24709): Terminated: ok {rc=0} 04:08:50.404716 --- ParallelTerminationStrategy: PID 24710 died... 04:08:50.423955 run iperf3-srv_10.42.42.10(pid=24710): Terminated {rc=256} 04:08:50.469628 --- ParallelTerminationStrategy: PID 24713 died... 04:08:50.488833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24713): Terminated: ok {rc=0} 04:08:50.534718 --- ParallelTerminationStrategy: PID 24716 died... 04:08:50.554155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24716): Terminated: ok {rc=0} 04:08:50.599888 --- ParallelTerminationStrategy: PID 24719 died... 04:08:50.619588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24719): Terminated: ok {rc=0} 04:08:50.706296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:08:51.852249 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:51.864307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:08:51.936898 tst iperf3m4.py: using LAC 25885 04:08:52.065753 tst iperf3m4.py: using RAC 130 04:08:52.187722 tst iperf3m4.py: using CellId 25885 04:08:52.310764 tst iperf3m4.py: using BVCI 25886 04:08:52.424059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.435541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.446941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.458506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.469997 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.481502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.493099 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.504457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:08:52.516155 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:08:52.633979 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:08:52.750342 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:08:52.868405 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:08:52.982984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:08:53.180895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:53.476880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24721): Launched 04:08:53.732639 run iperf3-srv_10.42.42.10(pid=24722): Launched 04:08:53.842776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:08:54.040271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:54.334566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24723): Launched 04:08:54.589642 run iperf3-srv_10.42.42.10(pid=24724): Launched 04:08:54.699748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:08:54.896378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:55.191148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24725): Launched 04:08:55.446797 run iperf3-srv_10.42.42.10(pid=24726): Launched 04:08:55.556557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:08:55.753618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:56.047477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Launched 04:08:56.302488 run iperf3-srv_10.42.42.10(pid=24728): Launched 04:08:56.412334 tst iperf3m4.py:8: start network... 04:08:56.608914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:57.062135 run create_hlr_db(pid=24729): Launched 04:08:57.175326 bus /gobi_6: Setting Powered False 04:08:58.234508 run create_hlr_db(pid=24729): Terminated: ok {rc=0} 04:08:58.643823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24731): Launched 04:08:58.936493 run osmo-hlr_10.42.42.2(pid=24732): Launched 04:08:59.048361 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:59.569957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24734): Launched 04:08:59.862166 run osmo-stp_10.42.42.5(pid=24735): Launched 04:08:59.973487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:00.477704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24737): Launched 04:09:00.590264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:00.853290 run patchelf(pid=24738): Launched 04:09:01.044727 run osmo-stp_10.42.42.5(pid=24735): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24735)] 04:09:01.181503 run osmo-stp_10.42.42.5(pid=24735): stdout: | (launched: 2022-12-10_04:08:59.808855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:01.320212 run osmo-stp_10.42.42.5(pid=24735): stderr: | 20221210040859976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040859976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040859976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040859976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040859977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040859977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040859977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:01.458734 run osmo-stp_10.42.42.5(pid=24735): stdout: | (launched: 2022-12-10_04:08:59.808855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:01.591185 run osmo-stp_10.42.42.5(pid=24735): stderr: | 20221210040859976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040859976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040859976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040859976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040859977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040859977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040859977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:01.748173 run patchelf(pid=24738): Terminating (SIGINT) 04:09:01.929550 run patchelf(pid=24738): Terminated: ok {rc=0} 04:09:02.060934 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24735): Process ended prematurely: osmo-stp_10.42.42.5(pid=24735) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24735)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:09:02.072211 tst iperf3m4.py:8: Test FAILED (10.3 sec) 04:09:02.101514 run osmo-hlr_10.42.42.2(pid=24732): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24732)] 04:09:02.151713 run osmo-hlr_10.42.42.2(pid=24732): stdout: | (launched: 2022-12-10_04:08:58.883384) 04:09:02.203407 run osmo-hlr_10.42.42.2(pid=24732): stderr: | 20221210040859059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040859059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040859059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040859059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040859059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040859059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040859072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040859080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040859080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040859080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:02.255007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24721): Terminating (SIGTERM) 04:09:02.296446 run iperf3-srv_10.42.42.10(pid=24722): Terminating (SIGTERM) 04:09:02.337773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24723): Terminating (SIGTERM) 04:09:02.379146 run iperf3-srv_10.42.42.10(pid=24724): Terminating (SIGTERM) 04:09:02.420244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24725): Terminating (SIGTERM) 04:09:02.461466 run iperf3-srv_10.42.42.10(pid=24726): Terminating (SIGTERM) 04:09:02.502651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Terminating (SIGTERM) 04:09:02.543744 run iperf3-srv_10.42.42.10(pid=24728): Terminating (SIGTERM) 04:09:02.584819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24731): Terminating (SIGTERM) 04:09:02.626840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24734): Terminating (SIGTERM) 04:09:02.668561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24737): Terminating (SIGTERM) 04:09:02.710130 --- ParallelTerminationStrategy: PID 24721 died... 04:09:02.729825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24721): Terminated: ok {rc=0} 04:09:02.775801 --- ParallelTerminationStrategy: PID 24722 died... 04:09:02.795123 run iperf3-srv_10.42.42.10(pid=24722): Terminated {rc=256} 04:09:02.840502 --- ParallelTerminationStrategy: PID 24723 died... 04:09:02.860236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24723): Terminated: ok {rc=0} 04:09:02.905829 --- ParallelTerminationStrategy: PID 24724 died... 04:09:02.925131 run iperf3-srv_10.42.42.10(pid=24724): Terminated {rc=256} 04:09:02.970570 --- ParallelTerminationStrategy: PID 24725 died... 04:09:02.989908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24725): Terminated: ok {rc=0} 04:09:03.036190 --- ParallelTerminationStrategy: PID 24726 died... 04:09:03.055658 run iperf3-srv_10.42.42.10(pid=24726): Terminated {rc=256} 04:09:03.101518 --- ParallelTerminationStrategy: PID 24727 died... 04:09:03.120998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Terminated: ok {rc=0} 04:09:03.167015 --- ParallelTerminationStrategy: PID 24728 died... 04:09:03.186557 run iperf3-srv_10.42.42.10(pid=24728): Terminated {rc=256} 04:09:03.232409 --- ParallelTerminationStrategy: PID 24731 died... 04:09:03.252004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24731): Terminated: ok {rc=0} 04:09:03.297937 --- ParallelTerminationStrategy: PID 24734 died... 04:09:03.317503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24734): Terminated: ok {rc=0} 04:09:03.363376 --- ParallelTerminationStrategy: PID 24737 died... 04:09:03.382977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24737): Terminated: ok {rc=0} 04:09:03.470197 bus /gobi_4: Setting Powered False 04:09:04.566772 bus /gobi_4: Setting Powered False 04:09:05.682447 bus /gobi_1: Setting Powered False 04:09:06.779421 bus /gobi_1: Setting Powered False 04:09:07.893479 bus /gobi_0: Setting Powered False 04:09:08.989987 bus /gobi_0: Setting Powered False 04:09:10.104862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:09:11.207158 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.219272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:11.292791 tst ping.py: using LAC 25886 04:09:11.414693 tst ping.py: using RAC 131 04:09:11.534807 tst ping.py: using CellId 25886 04:09:11.656532 tst ping.py: using BVCI 25887 04:09:11.769385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.781000 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.792366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.803737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.814964 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.826315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.837697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:11.848901 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:11.964926 tst ping.py:19: start network... 04:09:12.158355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:12.602648 run create_hlr_db(pid=24739): Launched 04:09:12.712575 bus /gobi_6: Setting Powered False 04:09:13.770751 run create_hlr_db(pid=24739): Terminated: ok {rc=0} 04:09:14.192046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24741): Launched 04:09:14.498590 run osmo-hlr_10.42.42.2(pid=24742): Launched 04:09:14.616048 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:15.152051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24744): Launched 04:09:15.456482 run osmo-stp_10.42.42.5(pid=24745): Launched 04:09:15.575253 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:16.123795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24747): Launched 04:09:16.252521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:16.525646 run patchelf(pid=24748): Launched 04:09:16.734284 run osmo-stp_10.42.42.5(pid=24745): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24745)] 04:09:16.904212 run osmo-stp_10.42.42.5(pid=24745): stdout: | (launched: 2022-12-10_04:09:15.401697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:17.074190 run osmo-stp_10.42.42.5(pid=24745): stderr: | 20221210040915588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040915589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040915589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040915589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040915591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040915592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040915592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:17.234570 run osmo-stp_10.42.42.5(pid=24745): stdout: | (launched: 2022-12-10_04:09:15.401697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:17.362100 run osmo-stp_10.42.42.5(pid=24745): stderr: | 20221210040915588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040915589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040915589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040915589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040915591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040915592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040915592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:17.511612 run patchelf(pid=24748): Terminating (SIGINT) 04:09:17.684437 run patchelf(pid=24748): Terminated: ok {rc=0} 04:09:17.809135 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24745): Process ended prematurely: osmo-stp_10.42.42.5(pid=24745) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24745)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 04:09:17.818860 tst ping.py:22: Test FAILED (6.6 sec) 04:09:17.846714 run osmo-hlr_10.42.42.2(pid=24742): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24742)] 04:09:17.895989 run osmo-hlr_10.42.42.2(pid=24742): stdout: | (launched: 2022-12-10_04:09:14.443315) 04:09:17.946945 run osmo-hlr_10.42.42.2(pid=24742): stderr: | 20221210040914640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040914640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040914640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040914640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040914640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040914640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040914652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040914660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040914661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040914661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:17.998267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24741): Terminating (SIGTERM) 04:09:18.039611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24744): Terminating (SIGTERM) 04:09:18.081053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24747): Terminating (SIGTERM) 04:09:18.122575 --- ParallelTerminationStrategy: PID 24741 died... 04:09:18.142293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24741): Terminated: ok {rc=0} 04:09:18.188600 --- ParallelTerminationStrategy: PID 24744 died... 04:09:18.207845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24744): Terminated: ok {rc=0} 04:09:18.253287 --- ParallelTerminationStrategy: PID 24747 died... 04:09:18.272339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24747): Terminated: ok {rc=0} 04:09:18.358580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:09:19.445866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:19.457838 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:19.539489 tst ping_idle_ping.py: using LAC 25887 04:09:19.661280 tst ping_idle_ping.py: using RAC 132 04:09:19.781204 tst ping_idle_ping.py: using CellId 25887 04:09:19.894071 tst ping_idle_ping.py: using BVCI 25888 04:09:20.007078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:20.018616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:20.029945 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:20.041861 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:20.053638 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:20.065726 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:20.078452 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:20.089800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:20.203850 tst ping_idle_ping.py:24: start network... 04:09:20.398870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:20.849219 run create_hlr_db(pid=24750): Launched 04:09:20.959140 bus /gobi_6: Setting Powered False 04:09:22.017225 run create_hlr_db(pid=24750): Terminated: ok {rc=0} 04:09:22.421736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24752): Launched 04:09:22.710013 run osmo-hlr_10.42.42.2(pid=24753): Launched 04:09:22.820122 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:23.328356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24755): Launched 04:09:23.618133 run osmo-stp_10.42.42.5(pid=24756): Launched 04:09:23.728244 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:24.227720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24758): Launched 04:09:24.338831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:24.583062 run patchelf(pid=24759): Launched 04:09:24.744288 run osmo-stp_10.42.42.5(pid=24756): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24756)] 04:09:24.867446 run osmo-stp_10.42.42.5(pid=24756): stdout: | (launched: 2022-12-10_04:09:23.564903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:24.991572 run osmo-stp_10.42.42.5(pid=24756): stderr: | 20221210040923733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040923733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040923733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040923734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040923734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040923734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040923734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:25.116611 run osmo-stp_10.42.42.5(pid=24756): stdout: | (launched: 2022-12-10_04:09:23.564903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:25.235400 run osmo-stp_10.42.42.5(pid=24756): stderr: | 20221210040923733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040923733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040923733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040923734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040923734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040923734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040923734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:25.376469 run patchelf(pid=24759): Terminating (SIGINT) 04:09:25.539274 run patchelf(pid=24759): Terminated: ok {rc=0} 04:09:25.657601 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24756): Process ended prematurely: osmo-stp_10.42.42.5(pid=24756) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24756)] [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:09:25.666620 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 04:09:25.693449 run osmo-hlr_10.42.42.2(pid=24753): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24753)] 04:09:25.740117 run osmo-hlr_10.42.42.2(pid=24753): stdout: | (launched: 2022-12-10_04:09:22.657729) 04:09:25.788624 run osmo-hlr_10.42.42.2(pid=24753): stderr: | 20221210040922833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040922833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040922833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040922833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040922833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040922833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040922848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040922858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040922858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040922858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:25.837642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24752): Terminating (SIGTERM) 04:09:25.876840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24755): Terminating (SIGTERM) 04:09:25.916288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24758): Terminating (SIGTERM) 04:09:25.955847 --- ParallelTerminationStrategy: PID 24752 died... 04:09:25.974646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24752): Terminated: ok {rc=0} 04:09:26.018394 --- ParallelTerminationStrategy: PID 24755 died... 04:09:26.036625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24755): Terminated: ok {rc=0} 04:09:26.081210 --- ParallelTerminationStrategy: PID 24758 died... 04:09:26.099485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24758): Terminated: ok {rc=0} 04:09:26.182573 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:09:27.489114 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:09:27.496325 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:09:27.529813 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:09:27.563886 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:09:27.617323 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:09:27.651072 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:09:27.685340 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:09:28.243122 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:09:28.248431 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.259825 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:09:28.329442 tst switch_tch_pdch.py: using LAC 25888 04:09:28.451837 tst switch_tch_pdch.py: using RAC 133 04:09:28.574409 tst switch_tch_pdch.py: using CellId 25888 04:09:28.699140 tst switch_tch_pdch.py: using BVCI 25889 04:09:28.810459 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.822201 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.833809 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.845335 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.856830 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.868724 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.880444 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:09:28.891978 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:09:29.007056 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:09:29.120275 tst switch_tch_pdch.py:51: start network... 04:09:29.313306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:29.758829 run create_hlr_db(pid=24763): Launched 04:09:29.868879 bus /gobi_6: Setting Powered False 04:09:30.934151 run create_hlr_db(pid=24763): Terminated: ok {rc=0} 04:09:31.404153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24765): Launched 04:09:31.717735 run osmo-hlr_10.42.42.2(pid=24766): Launched 04:09:31.986566 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:32.603353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24768): Launched 04:09:32.891434 run osmo-stp_10.42.42.5(pid=24769): Launched 04:09:33.001418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:33.497826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24771): Launched 04:09:33.607974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:33.850185 run patchelf(pid=24772): Launched 04:09:34.009761 run osmo-stp_10.42.42.5(pid=24769): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24769)] 04:09:34.131948 run osmo-stp_10.42.42.5(pid=24769): stdout: | (launched: 2022-12-10_04:09:32.838837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:34.255124 run osmo-stp_10.42.42.5(pid=24769): stderr: | 20221210040933006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040933006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040933006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040933007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040933007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040933007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040933007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:34.379093 run osmo-stp_10.42.42.5(pid=24769): stdout: | (launched: 2022-12-10_04:09:32.838837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:34.496838 run osmo-stp_10.42.42.5(pid=24769): stderr: | 20221210040933006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040933006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040933006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040933007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040933007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040933007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040933007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:34.636113 run patchelf(pid=24772): Terminating (SIGINT) 04:09:34.797746 run patchelf(pid=24772): Terminated: ok {rc=0} 04:09:34.914162 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24769): Process ended prematurely: osmo-stp_10.42.42.5(pid=24769) [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24769)] [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:09:34.923141 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:09:34.949529 run osmo-hlr_10.42.42.2(pid=24766): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24766)] 04:09:34.996378 run osmo-hlr_10.42.42.2(pid=24766): stdout: | (launched: 2022-12-10_04:09:31.651492) 04:09:35.045089 run osmo-hlr_10.42.42.2(pid=24766): stderr: | 20221210040931893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040931893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040931893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040931893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040931893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040931893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040931907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040931920 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040931920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040931921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:35.094109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24765): Terminating (SIGTERM) 04:09:35.133465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24768): Terminating (SIGTERM) 04:09:35.172748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24771): Terminating (SIGTERM) 04:09:35.212102 --- ParallelTerminationStrategy: PID 24765 died... 04:09:35.230834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24765): Terminated: ok {rc=0} 04:09:35.274404 --- ParallelTerminationStrategy: PID 24768 died... 04:09:35.292783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24768): Terminated: ok {rc=0} 04:09:35.336396 --- ParallelTerminationStrategy: PID 24771 died... 04:09:35.354706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24771): Terminated: ok {rc=0} 04:09:35.436539 bus /gobi_0: Setting Powered False 04:09:36.533353 bus /gobi_0: Setting Powered False 04:09:37.648369 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:09:38.894740 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:09:38.900519 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:09:38.934316 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:09:38.968608 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:09:39.021492 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:09:39.055382 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:09:39.089313 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:09:39.643847 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:09:39.650273 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:39.662696 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:09:39.734927 tst switch_tch_pdch.py: using LAC 25889 04:09:39.855394 tst switch_tch_pdch.py: using RAC 134 04:09:39.977075 tst switch_tch_pdch.py: using CellId 25889 04:09:40.097424 tst switch_tch_pdch.py: using BVCI 25890 04:09:40.210484 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:40.221979 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:40.233272 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:40.244497 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:40.255790 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:40.267073 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:40.278604 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:09:40.289904 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:09:40.401645 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:09:40.518142 tst switch_tch_pdch.py:51: start network... 04:09:40.725707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:41.175354 run create_hlr_db(pid=24776): Launched 04:09:41.300597 bus /gobi_6: Setting Powered False 04:09:42.361203 run create_hlr_db(pid=24776): Terminated: ok {rc=0} 04:09:42.764377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24778): Launched 04:09:43.071365 run osmo-hlr_10.42.42.2(pid=24779): Launched 04:09:43.188700 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:43.691669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24781): Launched 04:09:43.998476 run osmo-stp_10.42.42.5(pid=24782): Launched 04:09:44.115246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:44.619683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24784): Launched 04:09:44.730740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:44.973771 run patchelf(pid=24785): Launched 04:09:45.134612 run osmo-stp_10.42.42.5(pid=24782): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24782)] 04:09:45.257706 run osmo-stp_10.42.42.5(pid=24782): stdout: | (launched: 2022-12-10_04:09:43.942927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:45.382669 run osmo-stp_10.42.42.5(pid=24782): stderr: | 20221210040944133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040944133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040944133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040944133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040944134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040944134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040944134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:45.507105 run osmo-stp_10.42.42.5(pid=24782): stdout: | (launched: 2022-12-10_04:09:43.942927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:45.626554 run osmo-stp_10.42.42.5(pid=24782): stderr: | 20221210040944133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210040944133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210040944133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210040944133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210040944134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210040944134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210040944134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:45.767810 run patchelf(pid=24785): Terminating (SIGINT) 04:09:45.946307 run patchelf(pid=24785): Terminated: ok {rc=0} 04:09:46.074792 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24782): Process ended prematurely: osmo-stp_10.42.42.5(pid=24782) [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24782)] [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:09:46.084897 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 04:09:46.113943 run osmo-hlr_10.42.42.2(pid=24779): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24779)] 04:09:46.164201 run osmo-hlr_10.42.42.2(pid=24779): stdout: | (launched: 2022-12-10_04:09:43.015709) 04:09:46.217175 run osmo-hlr_10.42.42.2(pid=24779): stderr: | 20221210040943209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210040943210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210040943210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210040943210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210040943210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210040943210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210040943223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210040943231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210040943231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210040943231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:46.270287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24778): Terminating (SIGTERM) 04:09:46.313055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24781): Terminating (SIGTERM) 04:09:46.356332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24784): Terminating (SIGTERM) 04:09:46.401224 --- ParallelTerminationStrategy: PID 24778 died... 04:09:46.422225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24778): Terminated: ok {rc=0} 04:09:46.470544 --- ParallelTerminationStrategy: PID 24781 died... 04:09:46.490465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24781): Terminated: ok {rc=0} 04:09:46.537028 --- ParallelTerminationStrategy: PID 24784 died... 04:09:46.557080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24784): Terminated: ok {rc=0} 04:09:46.646426 bus /gobi_0: Setting Powered False 04:09:47.744656 bus /gobi_0: Setting Powered False 04:09:48.860525 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_sms:trx-umtrx --------------------------------------------------------------------- 04:09:50.108730 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:09:50.112666 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:09:50.145774 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 04:09:50.152604 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 04:09:50.208349 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:09:50.240816 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 04:09:50.247608 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 04:09:50.780121 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 04:09:50.785247 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 04:09:50.795841 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 04:09:50.842678 tst mo_mt_sms.py: using LAC 25890 04:09:50.955647 tst mo_mt_sms.py: using RAC 135 04:09:51.066977 tst mo_mt_sms.py: using CellId 25890 04:09:51.178706 tst mo_mt_sms.py: using BVCI 25891 04:09:51.282123 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:09:51.396313 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:09:51.508717 tst mo_mt_sms.py:9: start nitb and bts... 04:09:51.704384 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:09:52.294100 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24789): Launched 04:09:52.582265 run osmo-nitb_10.42.42.2(pid=24790): Launched 04:09:52.742273 run osmo-nitb_10.42.42.2(pid=24790): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24790)] 04:09:52.872220 run osmo-nitb_10.42.42.2(pid=24790): stdout: | (launched: 2022-12-10_04:09:52.529669) 04:09:53.004065 run osmo-nitb_10.42.42.2(pid=24790): stderr: | (launched: 2022-12-10_04:09:52.572288) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:09:53.135843 run osmo-nitb_10.42.42.2(pid=24790): stdout: | (launched: 2022-12-10_04:09:52.529669) 04:09:53.261718 run osmo-nitb_10.42.42.2(pid=24790): stderr: | (launched: 2022-12-10_04:09:52.572288) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24790) [trial-2369↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24790)] 04:09:53.690824 tst osmo-nitb_10.42.42.2(pid=24790): stdout: | (launched: 2022-12-10_04:09:52.529669) 04:09:53.809677 tst osmo-nitb_10.42.42.2(pid=24790): stderr: | (launched: 2022-12-10_04:09:52.572288) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:09:53.947529 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24790) [trial-2369↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24790)] [trial-2369↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 04:09:53.956075 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 04:09:53.962677 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24789): Terminating (SIGTERM) 04:09:54.171663 --- ParallelTerminationStrategy: PID 24789 died... 04:09:54.192113 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24789): Terminated: ok {rc=0} 04:09:54.276351 bus /sierra_3: Setting Powered False 04:09:55.376459 bus /sierra_3: Setting Powered False 04:09:56.492143 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:trx-umtrx --------------------------------------------------------------------- 04:09:57.692023 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:09:57.696214 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:09:57.730747 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:09:57.758632 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 04:09:57.811038 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:09:57.844519 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:09:57.872259 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 04:09:58.418726 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 04:09:58.425603 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:09:58.436450 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 04:09:58.486954 tst mo_mt_sms.py: using LAC 25891 04:09:58.599837 tst mo_mt_sms.py: using RAC 136 04:09:58.711450 tst mo_mt_sms.py: using CellId 25891 04:09:58.822818 tst mo_mt_sms.py: using BVCI 25892 04:09:58.935124 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:09:58.946288 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:09:58.957150 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:09:58.968395 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:09:58.979719 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:09:58.991052 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:09:59.107162 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:09:59.220907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:59.666828 run create_hlr_db(pid=24794): Launched 04:09:59.776626 bus /sierra_2: Setting Powered False 04:10:00.839400 run create_hlr_db(pid=24794): Terminated: ok {rc=0} 04:10:01.302745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24799): Launched 04:10:01.627430 run osmo-hlr_10.42.42.2(pid=24800): Launched 04:10:01.796308 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:02.446591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24802): Launched 04:10:02.753324 run osmo-stp_10.42.42.5(pid=24803): Launched 04:10:02.869527 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:03.423871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24805): Launched 04:10:03.730219 run osmo-msc_10.42.42.6(pid=24806): Launched 04:10:03.901964 run osmo-stp_10.42.42.5(pid=24803): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24803)] 04:10:04.032222 run osmo-stp_10.42.42.5(pid=24803): stdout: | (launched: 2022-12-10_04:10:02.697776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:04.162681 run osmo-stp_10.42.42.5(pid=24803): stderr: | 20221210041002889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041002889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041002889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041002889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041002892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041002892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041002892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:04.292301 run osmo-stp_10.42.42.5(pid=24803): stdout: | (launched: 2022-12-10_04:10:02.697776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:04.414705 run osmo-stp_10.42.42.5(pid=24803): stderr: | 20221210041002889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041002889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041002889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041002889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041002892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041002892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041002892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:04.561180 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24803): Process ended prematurely: osmo-stp_10.42.42.5(pid=24803) [trial-2369↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24803)] [trial-2369↪sms:trx-umtrx↪mo_mt_sms.py:16] 04:10:04.570146 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 04:10:04.597052 run osmo-hlr_10.42.42.2(pid=24800): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24800)] 04:10:04.646211 run osmo-hlr_10.42.42.2(pid=24800): stdout: | (launched: 2022-12-10_04:10:01.563685) 04:10:04.697642 run osmo-hlr_10.42.42.2(pid=24800): stderr: | 20221210041001918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041001918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041001918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041001918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041001918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041001918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041001935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041001961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041001962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041001962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:04.769028 run osmo-msc_10.42.42.6(pid=24806): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24806)] 04:10:04.818311 run osmo-msc_10.42.42.6(pid=24806): stdout: | (launched: 2022-12-10_04:10:03.674742) 04:10:04.869306 run osmo-msc_10.42.42.6(pid=24806): stderr: | 20221210041003994 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041003994 DLGLOBAL DEBUG validating counter group 0x7fd07927ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041003994 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041003994 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041003994 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041003995 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041003998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041003999 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041003999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041003999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:10:04.920506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24799): Terminating (SIGTERM) 04:10:04.961482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24802): Terminating (SIGTERM) 04:10:05.002363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24805): Terminating (SIGTERM) 04:10:05.043680 --- ParallelTerminationStrategy: PID 24799 died... 04:10:05.063294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24799): Terminated: ok {rc=0} 04:10:05.108646 --- ParallelTerminationStrategy: PID 24802 died... 04:10:05.127780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24802): Terminated: ok {rc=0} 04:10:05.174379 --- ParallelTerminationStrategy: PID 24805 died... 04:10:05.192413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24805): Terminated: ok {rc=0} 04:10:05.274409 bus /sierra_3: Setting Powered False 04:10:06.371837 bus /sierra_3: Setting Powered False 04:10:07.484938 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 04:10:08.716167 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:08.720130 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:08.754264 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 04:10:08.761194 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 04:10:08.797340 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:08.831119 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 04:10:08.837959 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 04:10:09.355334 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 04:10:09.360404 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 04:10:09.371220 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:09.419053 tst assert_extension.py: using LAC 25892 04:10:09.534279 tst assert_extension.py: using RAC 137 04:10:09.646815 tst assert_extension.py: using CellId 25892 04:10:09.759282 tst assert_extension.py: using BVCI 25893 04:10:09.862691 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 04:10:09.976739 tst assert_extension.py:10: start nitb and bts... 04:10:10.184477 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:10:10.813971 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24814): Launched 04:10:11.120060 run osmo-nitb_10.42.42.2(pid=24815): Launched 04:10:11.289869 run osmo-nitb_10.42.42.2(pid=24815): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24815)] 04:10:11.428076 run osmo-nitb_10.42.42.2(pid=24815): stdout: | (launched: 2022-12-10_04:10:11.064549) 04:10:11.567717 run osmo-nitb_10.42.42.2(pid=24815): stderr: | (launched: 2022-12-10_04:10:11.110273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:11.707857 run osmo-nitb_10.42.42.2(pid=24815): stdout: | (launched: 2022-12-10_04:10:11.064549) 04:10:11.842140 run osmo-nitb_10.42.42.2(pid=24815): stderr: | (launched: 2022-12-10_04:10:11.110273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24815): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24815) [trial-2369↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24815)] 04:10:12.235986 tst osmo-nitb_10.42.42.2(pid=24815): stdout: | (launched: 2022-12-10_04:10:11.064549) 04:10:12.360723 tst osmo-nitb_10.42.42.2(pid=24815): stderr: | (launched: 2022-12-10_04:10:11.110273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:12.508101 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24815): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24815) [trial-2369↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24815)] [trial-2369↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 04:10:12.517238 tst assert_extension.py:12: Test FAILED (3.1 sec) 04:10:12.524158 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24814): Terminating (SIGTERM) 04:10:12.735831 --- ParallelTerminationStrategy: PID 24814 died... 04:10:12.757982 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24814): Terminated: ok {rc=0} 04:10:12.845835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:trx-umtrx --------------------------------------------------------------------- 04:10:14.021890 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:14.026055 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:14.058891 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:10:14.086099 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 04:10:14.123181 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:14.155740 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:10:14.182084 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 04:10:14.710573 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 04:10:14.715931 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:14.726972 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:14.777822 tst assert_extension.py: using LAC 25893 04:10:14.893432 tst assert_extension.py: using RAC 138 04:10:15.013671 tst assert_extension.py: using CellId 25893 04:10:15.126042 tst assert_extension.py: using BVCI 25894 04:10:15.230745 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:15.241286 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:15.251582 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:15.262159 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:15.273383 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:15.283939 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 04:10:15.398664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:15.875273 run create_hlr_db(pid=24820): Launched 04:10:16.050155 bus /sierra_2: Setting Powered False 04:10:17.120147 run create_hlr_db(pid=24820): Terminated: ok {rc=0} 04:10:17.560748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24822): Launched 04:10:17.848777 run osmo-hlr_10.42.42.2(pid=24823): Launched 04:10:17.958739 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:18.458146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24825): Launched 04:10:18.744604 run osmo-stp_10.42.42.5(pid=24826): Launched 04:10:18.854113 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:19.374217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24828): Launched 04:10:19.662032 run osmo-msc_10.42.42.6(pid=24829): Launched 04:10:19.822620 run osmo-stp_10.42.42.5(pid=24826): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24826)] 04:10:19.944639 run osmo-stp_10.42.42.5(pid=24826): stdout: | (launched: 2022-12-10_04:10:18.692555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:20.067527 run osmo-stp_10.42.42.5(pid=24826): stderr: | 20221210041018860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041018860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041018861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041018861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041018863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041018863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041018864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:20.187592 run osmo-stp_10.42.42.5(pid=24826): stdout: | (launched: 2022-12-10_04:10:18.692555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:20.302143 run osmo-stp_10.42.42.5(pid=24826): stderr: | 20221210041018860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041018860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041018861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041018861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041018863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041018863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041018864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:20.439930 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24826): Process ended prematurely: osmo-stp_10.42.42.5(pid=24826) [trial-2369↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24826)] [trial-2369↪ussd:trx-umtrx↪assert_extension.py:17] 04:10:20.448247 tst assert_extension.py:17: Test FAILED (5.7 sec) 04:10:20.474354 run osmo-hlr_10.42.42.2(pid=24823): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24823)] 04:10:20.521350 run osmo-hlr_10.42.42.2(pid=24823): stdout: | (launched: 2022-12-10_04:10:17.796228) 04:10:20.569827 run osmo-hlr_10.42.42.2(pid=24823): stderr: | 20221210041017971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041017971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041017971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041017971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041017971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041017971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041017982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041017990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041017990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041017990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:20.637636 run osmo-msc_10.42.42.6(pid=24829): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24829)] 04:10:20.684608 run osmo-msc_10.42.42.6(pid=24829): stdout: | (launched: 2022-12-10_04:10:19.609607) 04:10:20.733170 run osmo-msc_10.42.42.6(pid=24829): stderr: | 20221210041019881 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041019881 DLGLOBAL DEBUG validating counter group 0x7f721fb8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041019881 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041019882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041019882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041019882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041019884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041019884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041019884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041019884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:10:20.782340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24822): Terminating (SIGTERM) 04:10:20.821668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24825): Terminating (SIGTERM) 04:10:20.861056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24828): Terminating (SIGTERM) 04:10:20.900448 --- ParallelTerminationStrategy: PID 24822 died... 04:10:20.919226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24822): Terminated: ok {rc=0} 04:10:20.962730 --- ParallelTerminationStrategy: PID 24825 died... 04:10:20.980986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24825): Terminated: ok {rc=0} 04:10:21.024297 --- ParallelTerminationStrategy: PID 24828 died... 04:10:21.042537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24828): Terminated: ok {rc=0} 04:10:21.124222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:10:22.335043 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:22.341887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:10:22.375484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:10:22.402794 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:10:22.455296 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:10:22.488286 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:10:22.515595 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:10:23.068250 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:10:23.119000 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:23.130728 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:10:23.200857 tst mo_mt_call.py: using LAC 25894 04:10:23.324820 tst mo_mt_call.py: using RAC 139 04:10:23.450825 tst mo_mt_call.py: using CellId 25894 04:10:23.576366 tst mo_mt_call.py: using BVCI 25895 04:10:23.690282 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:23.701778 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:23.713002 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:23.724393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:23.735783 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:23.747043 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:10:23.863824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:10:23.982136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:24.465872 run create_hlr_db(pid=24834): Launched 04:10:24.592129 bus /sierra_2: Setting Powered False 04:10:25.654598 run create_hlr_db(pid=24834): Terminated: ok {rc=0} 04:10:26.074128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24836): Launched 04:10:26.367108 run osmo-hlr_10.42.42.2(pid=24837): Launched 04:10:26.479082 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:26.994425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24839): Launched 04:10:27.288325 run osmo-stp_10.42.42.5(pid=24840): Launched 04:10:27.400300 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:27.931501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24842): Launched 04:10:28.225736 run osmo-msc_10.42.42.6(pid=24843): Launched 04:10:28.389764 run osmo-stp_10.42.42.5(pid=24840): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24840)] 04:10:28.514692 run osmo-stp_10.42.42.5(pid=24840): stdout: | (launched: 2022-12-10_04:10:27.234780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:28.639981 run osmo-stp_10.42.42.5(pid=24840): stderr: | 20221210041027401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041027402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041027402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041027402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041027404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041027405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041027405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:28.763403 run osmo-stp_10.42.42.5(pid=24840): stdout: | (launched: 2022-12-10_04:10:27.234780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:28.881083 run osmo-stp_10.42.42.5(pid=24840): stderr: | 20221210041027401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041027402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041027402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041027402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041027404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041027405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041027405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:29.021458 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24840): Process ended prematurely: osmo-stp_10.42.42.5(pid=24840) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24840)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:10:29.030763 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:10:29.057807 run osmo-hlr_10.42.42.2(pid=24837): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24837)] 04:10:29.105398 run osmo-hlr_10.42.42.2(pid=24837): stdout: | (launched: 2022-12-10_04:10:26.314121) 04:10:29.154873 run osmo-hlr_10.42.42.2(pid=24837): stderr: | 20221210041026488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041026488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041026488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041026488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041026488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041026488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041026501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041026510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041026510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041026510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:29.223401 run osmo-msc_10.42.42.6(pid=24843): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24843)] 04:10:29.270908 run osmo-msc_10.42.42.6(pid=24843): stdout: | (launched: 2022-12-10_04:10:28.171775) 04:10:29.320037 run osmo-msc_10.42.42.6(pid=24843): stderr: | 20221210041028441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041028442 DLGLOBAL DEBUG validating counter group 0x7f8f6ad33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041028442 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041028442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041028443 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041028443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041028444 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041028445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041028445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041028445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:10:29.369335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24836): Terminating (SIGTERM) 04:10:29.408940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24839): Terminating (SIGTERM) 04:10:29.448699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24842): Terminating (SIGTERM) 04:10:29.488607 --- ParallelTerminationStrategy: PID 24836 died... 04:10:29.507607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24836): Terminated: ok {rc=0} 04:10:29.552184 --- ParallelTerminationStrategy: PID 24839 died... 04:10:29.570783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24839): Terminated: ok {rc=0} 04:10:29.614916 --- ParallelTerminationStrategy: PID 24842 died... 04:10:29.633396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24842): Terminated: ok {rc=0} 04:10:29.715959 bus /sierra_3: Setting Powered False 04:10:30.810809 bus /sierra_3: Setting Powered False 04:10:31.934989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:10:33.080498 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:33.092306 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:10:33.161756 tst mo_mt_call_osmux.py: using LAC 25895 04:10:33.279141 tst mo_mt_call_osmux.py: using RAC 140 04:10:33.396918 tst mo_mt_call_osmux.py: using CellId 25895 04:10:33.511995 tst mo_mt_call_osmux.py: using BVCI 25896 04:10:33.618493 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:33.629650 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:33.640445 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:33.651618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:33.662811 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:10:33.674036 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:10:33.786431 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:10:33.905401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:34.391466 run create_hlr_db(pid=24845): Launched 04:10:34.519281 bus /sierra_2: Setting Powered False 04:10:35.581628 run create_hlr_db(pid=24845): Terminated: ok {rc=0} 04:10:36.001744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24847): Launched 04:10:36.294983 run osmo-hlr_10.42.42.2(pid=24848): Launched 04:10:36.407965 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:36.926489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24850): Launched 04:10:37.219317 run osmo-stp_10.42.42.5(pid=24851): Launched 04:10:37.330706 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:37.863646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24853): Launched 04:10:38.157688 run osmo-msc_10.42.42.6(pid=24854): Launched 04:10:38.322210 run osmo-stp_10.42.42.5(pid=24851): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24851)] 04:10:38.448039 run osmo-stp_10.42.42.5(pid=24851): stdout: | (launched: 2022-12-10_04:10:37.166307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:38.574100 run osmo-stp_10.42.42.5(pid=24851): stderr: | 20221210041037336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041037336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041037337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041037337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041037338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041037338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041037338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:38.697238 run osmo-stp_10.42.42.5(pid=24851): stdout: | (launched: 2022-12-10_04:10:37.166307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:38.814468 run osmo-stp_10.42.42.5(pid=24851): stderr: | 20221210041037336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041037336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041037337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041037337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041037338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041037338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041037338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:38.955086 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24851): Process ended prematurely: osmo-stp_10.42.42.5(pid=24851) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24851)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:10:38.964119 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 04:10:38.991118 run osmo-hlr_10.42.42.2(pid=24848): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24848)] 04:10:39.038376 run osmo-hlr_10.42.42.2(pid=24848): stdout: | (launched: 2022-12-10_04:10:36.241747) 04:10:39.087398 run osmo-hlr_10.42.42.2(pid=24848): stderr: | 20221210041036413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041036413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041036413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041036414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041036414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041036414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041036426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041036435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041036435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041036435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:39.156615 run osmo-msc_10.42.42.6(pid=24854): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24854)] 04:10:39.204016 run osmo-msc_10.42.42.6(pid=24854): stdout: | (launched: 2022-12-10_04:10:38.103628) 04:10:39.253175 run osmo-msc_10.42.42.6(pid=24854): stderr: | 20221210041038374 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041038374 DLGLOBAL DEBUG validating counter group 0x7f9349769c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041038375 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041038375 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041038375 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041038375 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041038377 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041038377 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041038377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041038377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:10:39.302516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24847): Terminating (SIGTERM) 04:10:39.342224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24850): Terminating (SIGTERM) 04:10:39.381994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24853): Terminating (SIGTERM) 04:10:39.421981 --- ParallelTerminationStrategy: PID 24847 died... 04:10:39.440748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24847): Terminated: ok {rc=0} 04:10:39.485119 --- ParallelTerminationStrategy: PID 24850 died... 04:10:39.503676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24850): Terminated: ok {rc=0} 04:10:39.547607 --- ParallelTerminationStrategy: PID 24853 died... 04:10:39.566125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24853): Terminated: ok {rc=0} 04:10:39.652539 bus /sierra_3: Setting Powered False 04:10:40.751486 bus /sierra_3: Setting Powered False 04:10:41.866585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:10:43.121838 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:43.128636 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:10:43.161777 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:10:43.189057 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:10:43.241871 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:10:43.275283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:10:43.302389 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:10:43.853006 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:10:43.903355 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:43.914955 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:10:43.984776 tst mo_mt_call.py: using LAC 25896 04:10:44.107102 tst mo_mt_call.py: using RAC 141 04:10:44.229587 tst mo_mt_call.py: using CellId 25896 04:10:44.353513 tst mo_mt_call.py: using BVCI 25897 04:10:44.466207 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:44.477738 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:44.488879 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:44.500137 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:44.511408 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:44.522812 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:10:44.636082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:10:44.754555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:45.239123 run create_hlr_db(pid=24859): Launched 04:10:45.365216 bus /sierra_2: Setting Powered False 04:10:46.427222 run create_hlr_db(pid=24859): Terminated: ok {rc=0} 04:10:46.875574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24861): Launched 04:10:47.196189 run osmo-hlr_10.42.42.2(pid=24862): Launched 04:10:47.315074 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:47.854025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24864): Launched 04:10:48.166252 run osmo-stp_10.42.42.5(pid=24865): Launched 04:10:48.285317 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:48.855024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24867): Launched 04:10:49.166801 run osmo-msc_10.42.42.6(pid=24868): Launched 04:10:49.341497 run osmo-stp_10.42.42.5(pid=24865): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24865)] 04:10:49.473849 run osmo-stp_10.42.42.5(pid=24865): stdout: | (launched: 2022-12-10_04:10:48.109982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:49.607196 run osmo-stp_10.42.42.5(pid=24865): stderr: | 20221210041048300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041048300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041048300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041048301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041048303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041048303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041048303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:49.740075 run osmo-stp_10.42.42.5(pid=24865): stdout: | (launched: 2022-12-10_04:10:48.109982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:49.865171 run osmo-stp_10.42.42.5(pid=24865): stderr: | 20221210041048300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041048300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041048300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041048301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041048303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041048303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041048303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:50.014742 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24865): Process ended prematurely: osmo-stp_10.42.42.5(pid=24865) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24865)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:10:50.024272 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:10:50.052052 run osmo-hlr_10.42.42.2(pid=24862): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24862)] 04:10:50.101661 run osmo-hlr_10.42.42.2(pid=24862): stdout: | (launched: 2022-12-10_04:10:47.139864) 04:10:50.153127 run osmo-hlr_10.42.42.2(pid=24862): stderr: | 20221210041047336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041047336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041047336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041047336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041047336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041047336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041047348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041047357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041047357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041047357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:50.224833 run osmo-msc_10.42.42.6(pid=24868): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24868)] 04:10:50.274724 run osmo-msc_10.42.42.6(pid=24868): stdout: | (launched: 2022-12-10_04:10:49.110437) 04:10:50.326269 run osmo-msc_10.42.42.6(pid=24868): stderr: | 20221210041049431 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041049431 DLGLOBAL DEBUG validating counter group 0x7f830071fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041049432 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041049432 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041049432 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041049432 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041049434 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041049434 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041049434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041049434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:10:50.377942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24861): Terminating (SIGTERM) 04:10:50.419162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24864): Terminating (SIGTERM) 04:10:50.460538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24867): Terminating (SIGTERM) 04:10:50.502211 --- ParallelTerminationStrategy: PID 24861 died... 04:10:50.521554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24861): Terminated: ok {rc=0} 04:10:50.567431 --- ParallelTerminationStrategy: PID 24864 died... 04:10:50.586963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24864): Terminated: ok {rc=0} 04:10:50.632871 --- ParallelTerminationStrategy: PID 24867 died... 04:10:50.652405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24867): Terminated: ok {rc=0} 04:10:50.739644 bus /sierra_3: Setting Powered False 04:10:51.837916 bus /sierra_3: Setting Powered False 04:10:52.952871 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:10:54.100244 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:54.112405 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:10:54.182954 tst mo_mt_call_osmux.py: using LAC 25897 04:10:54.307317 tst mo_mt_call_osmux.py: using RAC 142 04:10:54.431551 tst mo_mt_call_osmux.py: using CellId 25897 04:10:54.558157 tst mo_mt_call_osmux.py: using BVCI 25898 04:10:54.667032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:54.678434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:54.689470 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:54.700837 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:54.712330 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:10:54.723694 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:10:54.836039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:10:54.952616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:55.406539 run create_hlr_db(pid=24870): Launched 04:10:55.519078 bus /sierra_2: Setting Powered False 04:10:56.578383 run create_hlr_db(pid=24870): Terminated: ok {rc=0} 04:10:57.005951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24872): Launched 04:10:57.317570 run osmo-hlr_10.42.42.2(pid=24873): Launched 04:10:57.436627 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:57.977063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24875): Launched 04:10:58.288227 run osmo-stp_10.42.42.5(pid=24876): Launched 04:10:58.408333 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:58.974000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24878): Launched 04:10:59.286297 run osmo-msc_10.42.42.6(pid=24879): Launched 04:10:59.460871 run osmo-stp_10.42.42.5(pid=24876): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24876)] 04:10:59.593860 run osmo-stp_10.42.42.5(pid=24876): stdout: | (launched: 2022-12-10_04:10:58.232095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:59.727231 run osmo-stp_10.42.42.5(pid=24876): stderr: | 20221210041058423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041058423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041058424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041058424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041058424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041058424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041058425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:59.859727 run osmo-stp_10.42.42.5(pid=24876): stdout: | (launched: 2022-12-10_04:10:58.232095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:59.984598 run osmo-stp_10.42.42.5(pid=24876): stderr: | 20221210041058423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041058423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041058424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041058424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041058424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041058424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041058425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:00.134104 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24876): Process ended prematurely: osmo-stp_10.42.42.5(pid=24876) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24876)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:11:00.143746 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:11:00.171207 run osmo-hlr_10.42.42.2(pid=24873): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24873)] 04:11:00.220405 run osmo-hlr_10.42.42.2(pid=24873): stdout: | (launched: 2022-12-10_04:10:57.261447) 04:11:00.271178 run osmo-hlr_10.42.42.2(pid=24873): stderr: | 20221210041057457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041057457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041057457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041057457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041057457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041057457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041057470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041057478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041057478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041057478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:00.342638 run osmo-msc_10.42.42.6(pid=24879): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24879)] 04:11:00.391397 run osmo-msc_10.42.42.6(pid=24879): stdout: | (launched: 2022-12-10_04:10:59.229876) 04:11:00.442071 run osmo-msc_10.42.42.6(pid=24879): stderr: | 20221210041059550 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041059550 DLGLOBAL DEBUG validating counter group 0x7f564f28fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041059550 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041059550 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041059550 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041059551 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041059554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041059555 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041059555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041059555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:00.492880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24872): Terminating (SIGTERM) 04:11:00.533937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24875): Terminating (SIGTERM) 04:11:00.574905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24878): Terminating (SIGTERM) 04:11:00.616143 --- ParallelTerminationStrategy: PID 24872 died... 04:11:00.635767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24872): Terminated: ok {rc=0} 04:11:00.681284 --- ParallelTerminationStrategy: PID 24875 died... 04:11:00.700749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24875): Terminated: ok {rc=0} 04:11:00.746177 --- ParallelTerminationStrategy: PID 24878 died... 04:11:00.765308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24878): Terminated: ok {rc=0} 04:11:00.850086 bus /sierra_3: Setting Powered False 04:11:01.947902 bus /sierra_3: Setting Powered False 04:11:03.061942 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:11:04.310955 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:04.317706 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:11:04.351038 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:11:04.378441 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:11:04.432696 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:11:04.465318 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:11:04.492080 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:11:05.039493 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:11:05.091176 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:05.102623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:11:05.171522 tst mo_mt_call.py: using LAC 25898 04:11:05.288922 tst mo_mt_call.py: using RAC 143 04:11:05.406569 tst mo_mt_call.py: using CellId 25898 04:11:05.523213 tst mo_mt_call.py: using BVCI 25899 04:11:05.629571 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:05.640744 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:05.651766 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:05.663210 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:05.674620 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:05.685816 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:05.801706 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:05.919160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:06.404064 run create_hlr_db(pid=24884): Launched 04:11:06.532186 bus /sierra_2: Setting Powered False 04:11:07.595361 run create_hlr_db(pid=24884): Terminated: ok {rc=0} 04:11:08.014505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24886): Launched 04:11:08.307883 run osmo-hlr_10.42.42.2(pid=24887): Launched 04:11:08.420273 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:08.939336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24889): Launched 04:11:09.232334 run osmo-stp_10.42.42.5(pid=24890): Launched 04:11:09.344873 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:09.877103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24892): Launched 04:11:10.170410 run osmo-msc_10.42.42.6(pid=24893): Launched 04:11:10.334368 run osmo-stp_10.42.42.5(pid=24890): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24890)] 04:11:10.460334 run osmo-stp_10.42.42.5(pid=24890): stdout: | (launched: 2022-12-10_04:11:09.179171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:10.586212 run osmo-stp_10.42.42.5(pid=24890): stderr: | 20221210041109348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041109349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041109349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041109349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041109350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041109350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041109350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:10.708897 run osmo-stp_10.42.42.5(pid=24890): stdout: | (launched: 2022-12-10_04:11:09.179171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:10.826616 run osmo-stp_10.42.42.5(pid=24890): stderr: | 20221210041109348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041109349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041109349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041109349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041109350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041109350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041109350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:10.966811 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24890): Process ended prematurely: osmo-stp_10.42.42.5(pid=24890) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24890)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:11:10.975885 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 04:11:11.003095 run osmo-hlr_10.42.42.2(pid=24887): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24887)] 04:11:11.050621 run osmo-hlr_10.42.42.2(pid=24887): stdout: | (launched: 2022-12-10_04:11:08.254649) 04:11:11.099691 run osmo-hlr_10.42.42.2(pid=24887): stderr: | 20221210041108432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041108432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041108432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041108432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041108432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041108432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041108444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041108452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041108452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041108452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:11.168155 run osmo-msc_10.42.42.6(pid=24893): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24893)] 04:11:11.215472 run osmo-msc_10.42.42.6(pid=24893): stdout: | (launched: 2022-12-10_04:11:10.116811) 04:11:11.264645 run osmo-msc_10.42.42.6(pid=24893): stderr: | 20221210041110386 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041110386 DLGLOBAL DEBUG validating counter group 0x7f4db1a94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041110386 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041110387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041110387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041110387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041110390 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041110391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041110391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041110391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:11.313877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24886): Terminating (SIGTERM) 04:11:11.353448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24889): Terminating (SIGTERM) 04:11:11.393070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24892): Terminating (SIGTERM) 04:11:11.432843 --- ParallelTerminationStrategy: PID 24886 died... 04:11:11.451823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24886): Terminated: ok {rc=0} 04:11:11.495864 --- ParallelTerminationStrategy: PID 24889 died... 04:11:11.514335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24889): Terminated: ok {rc=0} 04:11:11.558062 --- ParallelTerminationStrategy: PID 24892 died... 04:11:11.576513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24892): Terminated: ok {rc=0} 04:11:11.658643 bus /sierra_3: Setting Powered False 04:11:12.753453 bus /sierra_3: Setting Powered False 04:11:13.865493 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:11:15.010850 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:15.022916 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:11:15.093144 tst mo_mt_call_osmux.py: using LAC 25899 04:11:15.215727 tst mo_mt_call_osmux.py: using RAC 144 04:11:15.338765 tst mo_mt_call_osmux.py: using CellId 25899 04:11:15.461691 tst mo_mt_call_osmux.py: using BVCI 25900 04:11:15.575296 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:15.586850 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:15.598224 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:15.609594 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:15.621492 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:15.632669 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:15.745644 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:15.877826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:16.376342 run create_hlr_db(pid=24895): Launched 04:11:16.535277 bus /sierra_2: Setting Powered False 04:11:17.598614 run create_hlr_db(pid=24895): Terminated: ok {rc=0} 04:11:18.020582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24897): Launched 04:11:18.315172 run osmo-hlr_10.42.42.2(pid=24898): Launched 04:11:18.426745 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:18.946824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24900): Launched 04:11:19.240044 run osmo-stp_10.42.42.5(pid=24901): Launched 04:11:19.352121 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:19.883525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24903): Launched 04:11:20.175746 run osmo-msc_10.42.42.6(pid=24904): Launched 04:11:20.340754 run osmo-stp_10.42.42.5(pid=24901): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24901)] 04:11:20.466663 run osmo-stp_10.42.42.5(pid=24901): stdout: | (launched: 2022-12-10_04:11:19.186615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:20.591921 run osmo-stp_10.42.42.5(pid=24901): stderr: | 20221210041119355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041119355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041119356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041119356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041119357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041119357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041119357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:20.714115 run osmo-stp_10.42.42.5(pid=24901): stdout: | (launched: 2022-12-10_04:11:19.186615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:20.831442 run osmo-stp_10.42.42.5(pid=24901): stderr: | 20221210041119355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041119355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041119356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041119356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041119357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041119357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041119357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:20.971640 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24901): Process ended prematurely: osmo-stp_10.42.42.5(pid=24901) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24901)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:11:20.980587 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:11:21.007122 run osmo-hlr_10.42.42.2(pid=24898): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24898)] 04:11:21.053902 run osmo-hlr_10.42.42.2(pid=24898): stdout: | (launched: 2022-12-10_04:11:18.261704) 04:11:21.102369 run osmo-hlr_10.42.42.2(pid=24898): stderr: | 20221210041118437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041118437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041118437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041118437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041118437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041118437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041118452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041118461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041118461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041118461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:21.170068 run osmo-msc_10.42.42.6(pid=24904): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24904)] 04:11:21.216554 run osmo-msc_10.42.42.6(pid=24904): stdout: | (launched: 2022-12-10_04:11:20.122628) 04:11:21.264694 run osmo-msc_10.42.42.6(pid=24904): stderr: | 20221210041120393 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041120393 DLGLOBAL DEBUG validating counter group 0x7f0f4582dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041120393 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041120393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041120393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041120393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041120395 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041120395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041120396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041120396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:21.313298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24897): Terminating (SIGTERM) 04:11:21.351942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24900): Terminating (SIGTERM) 04:11:21.390852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24903): Terminating (SIGTERM) 04:11:21.430100 --- ParallelTerminationStrategy: PID 24897 died... 04:11:21.448526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24897): Terminated: ok {rc=0} 04:11:21.492490 --- ParallelTerminationStrategy: PID 24900 died... 04:11:21.510614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24900): Terminated: ok {rc=0} 04:11:21.553618 --- ParallelTerminationStrategy: PID 24903 died... 04:11:21.571773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24903): Terminated: ok {rc=0} 04:11:21.655740 bus /sierra_3: Setting Powered False 04:11:22.753530 bus /sierra_3: Setting Powered False 04:11:23.867254 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:11:25.112071 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:25.118562 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:11:25.151598 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:11:25.177951 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:11:25.229248 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:11:25.261496 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:11:25.287672 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:11:25.839216 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:11:25.886809 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:25.897876 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:11:25.969321 tst mo_mt_call.py: using LAC 25900 04:11:26.092186 tst mo_mt_call.py: using RAC 145 04:11:26.213253 tst mo_mt_call.py: using CellId 25900 04:11:26.334313 tst mo_mt_call.py: using BVCI 25901 04:11:26.447777 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:26.459172 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:26.470746 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:26.481983 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:26.493541 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:26.504916 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:11:26.622148 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:11:26.738843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:27.194692 run create_hlr_db(pid=24909): Launched 04:11:27.307157 bus /sierra_2: Setting Powered False 04:11:28.366162 run create_hlr_db(pid=24909): Terminated: ok {rc=0} 04:11:28.776758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24911): Launched 04:11:29.070053 run osmo-hlr_10.42.42.2(pid=24912): Launched 04:11:29.182187 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:29.685854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24914): Launched 04:11:29.979129 run osmo-stp_10.42.42.5(pid=24915): Launched 04:11:30.090787 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:30.622248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24917): Launched 04:11:30.931547 run osmo-msc_10.42.42.6(pid=24918): Launched 04:11:31.256930 run osmo-stp_10.42.42.5(pid=24915): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24915)] 04:11:31.595927 run osmo-stp_10.42.42.5(pid=24915): stdout: | (launched: 2022-12-10_04:11:29.925885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:31.781290 run osmo-stp_10.42.42.5(pid=24915): stderr: | 20221210041130096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041130097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041130097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041130097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041130098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041130098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041130098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:31.908097 run osmo-stp_10.42.42.5(pid=24915): stdout: | (launched: 2022-12-10_04:11:29.925885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:32.028575 run osmo-stp_10.42.42.5(pid=24915): stderr: | 20221210041130096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041130097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041130097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041130097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041130098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041130098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041130098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:32.172742 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24915): Process ended prematurely: osmo-stp_10.42.42.5(pid=24915) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24915)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:11:32.182846 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:11:32.212687 run osmo-hlr_10.42.42.2(pid=24912): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24912)] 04:11:32.262551 run osmo-hlr_10.42.42.2(pid=24912): stdout: | (launched: 2022-12-10_04:11:29.016603) 04:11:32.313718 run osmo-hlr_10.42.42.2(pid=24912): stderr: | 20221210041129191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041129191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041129191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041129191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041129191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041129191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041129203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041129211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041129212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041129212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:32.383912 run osmo-msc_10.42.42.6(pid=24918): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24918)] 04:11:32.433304 run osmo-msc_10.42.42.6(pid=24918): stdout: | (launched: 2022-12-10_04:11:30.863394) 04:11:32.482485 run osmo-msc_10.42.42.6(pid=24918): stderr: | 20221210041131366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041131367 DLGLOBAL DEBUG validating counter group 0x7fd1cf95ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041131367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041131367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041131367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041131367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041131370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041131371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041131371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041131371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:32.532151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24911): Terminating (SIGTERM) 04:11:32.571976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24914): Terminating (SIGTERM) 04:11:32.611731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24917): Terminating (SIGTERM) 04:11:32.651405 --- ParallelTerminationStrategy: PID 24911 died... 04:11:32.670183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24911): Terminated: ok {rc=0} 04:11:32.714903 --- ParallelTerminationStrategy: PID 24914 died... 04:11:32.733262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24914): Terminated: ok {rc=0} 04:11:32.777264 --- ParallelTerminationStrategy: PID 24917 died... 04:11:32.795506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24917): Terminated: ok {rc=0} 04:11:32.880909 bus /sierra_3: Setting Powered False 04:11:33.977609 bus /sierra_3: Setting Powered False 04:11:35.091404 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:11:36.233486 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:36.245232 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:11:36.317000 tst mo_mt_call_osmux.py: using LAC 25901 04:11:36.432212 tst mo_mt_call_osmux.py: using RAC 146 04:11:36.546758 tst mo_mt_call_osmux.py: using CellId 25901 04:11:36.661655 tst mo_mt_call_osmux.py: using BVCI 25902 04:11:36.768179 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:36.779182 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:36.790070 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:36.801076 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:36.812223 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:11:36.823307 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:11:36.939424 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:11:37.054905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:37.509657 run create_hlr_db(pid=24920): Launched 04:11:37.621093 bus /sierra_2: Setting Powered False 04:11:38.680348 run create_hlr_db(pid=24920): Terminated: ok {rc=0} 04:11:39.109367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24922): Launched 04:11:39.421546 run osmo-hlr_10.42.42.2(pid=24923): Launched 04:11:39.540882 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:40.086774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24925): Launched 04:11:40.399710 run osmo-stp_10.42.42.5(pid=24926): Launched 04:11:40.519194 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:41.087184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24928): Launched 04:11:41.398833 run osmo-msc_10.42.42.6(pid=24929): Launched 04:11:41.573339 run osmo-stp_10.42.42.5(pid=24926): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24926)] 04:11:41.705908 run osmo-stp_10.42.42.5(pid=24926): stdout: | (launched: 2022-12-10_04:11:40.343409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:41.838932 run osmo-stp_10.42.42.5(pid=24926): stderr: | 20221210041140535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041140535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041140535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041140536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041140536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041140536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041140536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:41.972531 run osmo-stp_10.42.42.5(pid=24926): stdout: | (launched: 2022-12-10_04:11:40.343409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:42.097286 run osmo-stp_10.42.42.5(pid=24926): stderr: | 20221210041140535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041140535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041140535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041140536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041140536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041140536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041140536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:42.246063 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24926): Process ended prematurely: osmo-stp_10.42.42.5(pid=24926) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24926)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:11:42.255900 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:11:42.283633 run osmo-hlr_10.42.42.2(pid=24923): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24923)] 04:11:42.332936 run osmo-hlr_10.42.42.2(pid=24923): stdout: | (launched: 2022-12-10_04:11:39.365347) 04:11:42.383762 run osmo-hlr_10.42.42.2(pid=24923): stderr: | 20221210041139561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041139561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041139561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041139561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041139561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041139561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041139574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041139582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041139583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041139583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:42.454758 run osmo-msc_10.42.42.6(pid=24929): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24929)] 04:11:42.503944 run osmo-msc_10.42.42.6(pid=24929): stdout: | (launched: 2022-12-10_04:11:41.342260) 04:11:42.554657 run osmo-msc_10.42.42.6(pid=24929): stderr: | 20221210041141664 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041141664 DLGLOBAL DEBUG validating counter group 0x7f4b79daec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041141664 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041141664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041141664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041141664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041141666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041141667 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041141667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041141667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:42.605726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24922): Terminating (SIGTERM) 04:11:42.646587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24925): Terminating (SIGTERM) 04:11:42.687654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24928): Terminating (SIGTERM) 04:11:42.729162 --- ParallelTerminationStrategy: PID 24922 died... 04:11:42.748820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24922): Terminated: ok {rc=0} 04:11:42.794278 --- ParallelTerminationStrategy: PID 24925 died... 04:11:42.813587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24925): Terminated: ok {rc=0} 04:11:42.858869 --- ParallelTerminationStrategy: PID 24928 died... 04:11:42.878168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24928): Terminated: ok {rc=0} 04:11:42.963580 bus /sierra_3: Setting Powered False 04:11:44.060151 bus /sierra_3: Setting Powered False 04:11:45.172775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:11:46.458163 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:46.468276 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:11:46.510815 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:11:46.546085 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:11:46.606514 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:11:46.645706 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:11:46.675371 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:11:47.221425 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:11:47.270948 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:47.283015 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:11:47.353184 tst mo_mt_call.py: using LAC 25902 04:11:47.470785 tst mo_mt_call.py: using RAC 147 04:11:47.585791 tst mo_mt_call.py: using CellId 25902 04:11:47.706177 tst mo_mt_call.py: using BVCI 25903 04:11:47.815114 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:47.826339 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:47.837386 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:47.848464 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:47.859572 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:47.870637 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:11:47.986550 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:11:48.097888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:48.551909 run create_hlr_db(pid=24934): Launched 04:11:48.664371 bus /sierra_2: Setting Powered False 04:11:49.723990 run create_hlr_db(pid=24934): Terminated: ok {rc=0} 04:11:50.151787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24936): Launched 04:11:50.464182 run osmo-hlr_10.42.42.2(pid=24937): Launched 04:11:50.584872 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:51.125675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24939): Launched 04:11:51.438048 run osmo-stp_10.42.42.5(pid=24940): Launched 04:11:51.558083 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:52.125809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24942): Launched 04:11:52.437835 run osmo-msc_10.42.42.6(pid=24943): Launched 04:11:52.615157 run osmo-stp_10.42.42.5(pid=24940): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24940)] 04:11:52.748705 run osmo-stp_10.42.42.5(pid=24940): stdout: | (launched: 2022-12-10_04:11:51.381620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:52.882378 run osmo-stp_10.42.42.5(pid=24940): stderr: | 20221210041151571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041151571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041151572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041151572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041151572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041151573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041151573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:53.016327 run osmo-stp_10.42.42.5(pid=24940): stdout: | (launched: 2022-12-10_04:11:51.381620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:53.141880 run osmo-stp_10.42.42.5(pid=24940): stderr: | 20221210041151571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041151571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041151572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041151572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041151572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041151573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041151573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:53.291339 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24940): Process ended prematurely: osmo-stp_10.42.42.5(pid=24940) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24940)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:11:53.301018 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:11:53.328419 run osmo-hlr_10.42.42.2(pid=24937): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24937)] 04:11:53.378234 run osmo-hlr_10.42.42.2(pid=24937): stdout: | (launched: 2022-12-10_04:11:50.407753) 04:11:53.430015 run osmo-hlr_10.42.42.2(pid=24937): stderr: | 20221210041150605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041150605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041150605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041150605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041150605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041150605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041150618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041150627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041150627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041150627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:53.501642 run osmo-msc_10.42.42.6(pid=24943): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24943)] 04:11:53.551633 run osmo-msc_10.42.42.6(pid=24943): stdout: | (launched: 2022-12-10_04:11:52.381506) 04:11:53.602961 run osmo-msc_10.42.42.6(pid=24943): stderr: | 20221210041152701 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041152701 DLGLOBAL DEBUG validating counter group 0x7fbd3c3d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041152701 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041152701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041152701 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041152701 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041152703 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041152703 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041152704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041152704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:53.654508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24936): Terminating (SIGTERM) 04:11:53.696307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24939): Terminating (SIGTERM) 04:11:53.738041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24942): Terminating (SIGTERM) 04:11:53.779707 --- ParallelTerminationStrategy: PID 24936 died... 04:11:53.799522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24936): Terminated: ok {rc=0} 04:11:53.845206 --- ParallelTerminationStrategy: PID 24939 died... 04:11:53.864647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24939): Terminated: ok {rc=0} 04:11:53.910510 --- ParallelTerminationStrategy: PID 24942 died... 04:11:53.929820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24942): Terminated: ok {rc=0} 04:11:54.015858 bus /sierra_3: Setting Powered False 04:11:55.113721 bus /sierra_3: Setting Powered False 04:11:56.229432 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:11:57.375830 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:57.387872 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:11:57.458808 tst mo_mt_call_osmux.py: using LAC 25903 04:11:57.582665 tst mo_mt_call_osmux.py: using RAC 148 04:11:57.709191 tst mo_mt_call_osmux.py: using CellId 25903 04:11:57.832015 tst mo_mt_call_osmux.py: using BVCI 25904 04:11:57.945287 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:57.956764 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:57.968649 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:57.979979 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:57.991363 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:11:58.002677 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:11:58.117913 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:11:58.231774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:58.687323 run create_hlr_db(pid=24945): Launched 04:11:58.800574 bus /sierra_2: Setting Powered False 04:11:59.859986 run create_hlr_db(pid=24945): Terminated: ok {rc=0} 04:12:00.289362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24947): Launched 04:12:00.602894 run osmo-hlr_10.42.42.2(pid=24948): Launched 04:12:00.723403 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:01.313941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24950): Launched 04:12:01.705283 run osmo-stp_10.42.42.5(pid=24951): Launched 04:12:01.912641 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:02.558324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24953): Launched 04:12:02.872046 run osmo-msc_10.42.42.6(pid=24954): Launched 04:12:03.045713 run osmo-stp_10.42.42.5(pid=24951): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24951)] 04:12:03.177155 run osmo-stp_10.42.42.5(pid=24951): stdout: | (launched: 2022-12-10_04:12:01.645312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:03.308639 run osmo-stp_10.42.42.5(pid=24951): stderr: | 20221210041201891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041201892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041201892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041201892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041201894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041201894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041201894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:03.440089 run osmo-stp_10.42.42.5(pid=24951): stdout: | (launched: 2022-12-10_04:12:01.645312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:03.564799 run osmo-stp_10.42.42.5(pid=24951): stderr: | 20221210041201891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041201892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041201892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041201892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041201894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041201894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041201894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:03.714629 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24951): Process ended prematurely: osmo-stp_10.42.42.5(pid=24951) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24951)] [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:12:03.724521 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:12:03.752269 run osmo-hlr_10.42.42.2(pid=24948): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24948)] 04:12:03.802135 run osmo-hlr_10.42.42.2(pid=24948): stdout: | (launched: 2022-12-10_04:12:00.546014) 04:12:03.853375 run osmo-hlr_10.42.42.2(pid=24948): stderr: | 20221210041200741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041200741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041200741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041200741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041200741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041200741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041200753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041200761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041200761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041200761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:03.925194 run osmo-msc_10.42.42.6(pid=24954): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24954)] 04:12:03.974520 run osmo-msc_10.42.42.6(pid=24954): stdout: | (launched: 2022-12-10_04:12:02.815008) 04:12:04.025691 run osmo-msc_10.42.42.6(pid=24954): stderr: | 20221210041203138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041203138 DLGLOBAL DEBUG validating counter group 0x7f1cd130ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041203138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041203138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041203139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041203139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041203141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041203141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041203141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041203141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:04.077195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24947): Terminating (SIGTERM) 04:12:04.118547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24950): Terminating (SIGTERM) 04:12:04.159946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24953): Terminating (SIGTERM) 04:12:04.201534 --- ParallelTerminationStrategy: PID 24947 died... 04:12:04.221479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24947): Terminated: ok {rc=0} 04:12:04.267839 --- ParallelTerminationStrategy: PID 24950 died... 04:12:04.287370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24950): Terminated: ok {rc=0} 04:12:04.333204 --- ParallelTerminationStrategy: PID 24953 died... 04:12:04.352486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24953): Terminated: ok {rc=0} 04:12:04.439448 bus /sierra_3: Setting Powered False 04:12:05.537519 bus /sierra_3: Setting Powered False 04:12:06.651727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:12:07.907366 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:07.914630 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:12:07.948480 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:12:07.975654 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:12:08.028007 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:12:08.060518 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:12:08.087586 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:12:08.640794 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:12:08.690984 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:08.702541 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:12:08.773511 tst mo_mt_call.py: using LAC 25904 04:12:08.896905 tst mo_mt_call.py: using RAC 149 04:12:09.021731 tst mo_mt_call.py: using CellId 25904 04:12:09.144023 tst mo_mt_call.py: using BVCI 25905 04:12:09.257313 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:09.268782 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:09.280187 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:09.291497 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:09.302917 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:09.314260 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:12:09.426455 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:12:09.543863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:10.028452 run create_hlr_db(pid=24960): Launched 04:12:10.155370 bus /sierra_2: Setting Powered False 04:12:11.217647 run create_hlr_db(pid=24960): Terminated: ok {rc=0} 04:12:11.636342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24962): Launched 04:12:11.930735 run osmo-hlr_10.42.42.2(pid=24963): Launched 04:12:12.042761 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:12.547071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24965): Launched 04:12:12.839913 run osmo-stp_10.42.42.5(pid=24966): Launched 04:12:12.952679 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:13.482995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24968): Launched 04:12:13.776071 run osmo-msc_10.42.42.6(pid=24969): Launched 04:12:13.940641 run osmo-stp_10.42.42.5(pid=24966): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24966)] 04:12:14.065804 run osmo-stp_10.42.42.5(pid=24966): stdout: | (launched: 2022-12-10_04:12:12.786725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:14.191606 run osmo-stp_10.42.42.5(pid=24966): stderr: | 20221210041212954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041212954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041212954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041212955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041212957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041212957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041212957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:14.315008 run osmo-stp_10.42.42.5(pid=24966): stdout: | (launched: 2022-12-10_04:12:12.786725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:14.432356 run osmo-stp_10.42.42.5(pid=24966): stderr: | 20221210041212954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041212954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041212954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041212955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041212957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041212957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041212957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:14.572659 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24966): Process ended prematurely: osmo-stp_10.42.42.5(pid=24966) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24966)] [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:12:14.581806 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 04:12:14.608820 run osmo-hlr_10.42.42.2(pid=24963): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24963)] 04:12:14.655980 run osmo-hlr_10.42.42.2(pid=24963): stdout: | (launched: 2022-12-10_04:12:11.877260) 04:12:14.705158 run osmo-hlr_10.42.42.2(pid=24963): stderr: | 20221210041212050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041212050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041212050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041212050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041212050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041212050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041212062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041212071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041212071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041212071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:14.773624 run osmo-msc_10.42.42.6(pid=24969): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24969)] 04:12:14.820658 run osmo-msc_10.42.42.6(pid=24969): stdout: | (launched: 2022-12-10_04:12:13.722623) 04:12:14.869197 run osmo-msc_10.42.42.6(pid=24969): stderr: | 20221210041213995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041213995 DLGLOBAL DEBUG validating counter group 0x7f86e8b73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041213995 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041213995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041213995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041213996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041213997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041213998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041213998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041213998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:14.918717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24962): Terminating (SIGTERM) 04:12:14.958340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24965): Terminating (SIGTERM) 04:12:14.997945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24968): Terminating (SIGTERM) 04:12:15.037767 --- ParallelTerminationStrategy: PID 24962 died... 04:12:15.056507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24962): Terminated: ok {rc=0} 04:12:15.100755 --- ParallelTerminationStrategy: PID 24965 died... 04:12:15.119359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24965): Terminated: ok {rc=0} 04:12:15.163222 --- ParallelTerminationStrategy: PID 24968 died... 04:12:15.181765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24968): Terminated: ok {rc=0} 04:12:15.266829 bus /sierra_3: Setting Powered False 04:12:16.362155 bus /sierra_3: Setting Powered False 04:12:17.474613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:12:18.620809 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:18.633062 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:12:18.703988 tst mo_mt_call_osmux.py: using LAC 25905 04:12:18.829456 tst mo_mt_call_osmux.py: using RAC 150 04:12:18.951898 tst mo_mt_call_osmux.py: using CellId 25905 04:12:19.075548 tst mo_mt_call_osmux.py: using BVCI 25906 04:12:19.190330 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:19.202028 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:19.213503 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:19.224759 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:19.236354 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:19.247893 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:12:19.365347 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:12:19.479034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:19.937194 run create_hlr_db(pid=24971): Launched 04:12:20.050286 bus /sierra_2: Setting Powered False 04:12:21.109791 run create_hlr_db(pid=24971): Terminated: ok {rc=0} 04:12:21.520672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24973): Launched 04:12:21.814904 run osmo-hlr_10.42.42.2(pid=24974): Launched 04:12:21.926837 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:22.445529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24976): Launched 04:12:22.738489 run osmo-stp_10.42.42.5(pid=24977): Launched 04:12:22.850947 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:23.383237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24979): Launched 04:12:23.677111 run osmo-msc_10.42.42.6(pid=24980): Launched 04:12:23.841452 run osmo-stp_10.42.42.5(pid=24977): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24977)] 04:12:23.966531 run osmo-stp_10.42.42.5(pid=24977): stdout: | (launched: 2022-12-10_04:12:22.685179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:24.092424 run osmo-stp_10.42.42.5(pid=24977): stderr: | 20221210041222852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041222852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041222852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041222853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041222855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041222855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041222855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:24.215344 run osmo-stp_10.42.42.5(pid=24977): stdout: | (launched: 2022-12-10_04:12:22.685179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:24.332612 run osmo-stp_10.42.42.5(pid=24977): stderr: | 20221210041222852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041222852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041222852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041222853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041222855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041222855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041222855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:24.473479 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24977): Process ended prematurely: osmo-stp_10.42.42.5(pid=24977) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24977)] [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:12:24.482536 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 04:12:24.509122 run osmo-hlr_10.42.42.2(pid=24974): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24974)] 04:12:24.556005 run osmo-hlr_10.42.42.2(pid=24974): stdout: | (launched: 2022-12-10_04:12:21.761649) 04:12:24.604680 run osmo-hlr_10.42.42.2(pid=24974): stderr: | 20221210041221935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041221935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041221935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041221936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041221936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041221936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041221947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041221956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041221956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041221956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:24.672658 run osmo-msc_10.42.42.6(pid=24980): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24980)] 04:12:24.719540 run osmo-msc_10.42.42.6(pid=24980): stdout: | (launched: 2022-12-10_04:12:23.623634) 04:12:24.768024 run osmo-msc_10.42.42.6(pid=24980): stderr: | 20221210041223894 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041223895 DLGLOBAL DEBUG validating counter group 0x7fa0223d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041223895 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041223895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041223895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041223895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041223897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041223897 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041223897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041223897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:24.817120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24973): Terminating (SIGTERM) 04:12:24.856632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24976): Terminating (SIGTERM) 04:12:24.895857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24979): Terminating (SIGTERM) 04:12:24.935383 --- ParallelTerminationStrategy: PID 24973 died... 04:12:24.954154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24973): Terminated: ok {rc=0} 04:12:24.998092 --- ParallelTerminationStrategy: PID 24976 died... 04:12:25.016305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24976): Terminated: ok {rc=0} 04:12:25.060203 --- ParallelTerminationStrategy: PID 24979 died... 04:12:25.078553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24979): Terminated: ok {rc=0} 04:12:25.161293 bus /sierra_3: Setting Powered False 04:12:26.257911 bus /sierra_3: Setting Powered False 04:12:27.372677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:12:28.621975 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:28.628035 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:12:28.661900 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:12:28.689706 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:12:28.743535 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:12:28.777055 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:12:28.804742 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:12:29.354540 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:12:29.404810 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:29.416193 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:12:29.486417 tst mo_mt_call.py: using LAC 25906 04:12:29.611368 tst mo_mt_call.py: using RAC 151 04:12:29.734977 tst mo_mt_call.py: using CellId 25906 04:12:29.858406 tst mo_mt_call.py: using BVCI 25907 04:12:29.973077 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:29.984355 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:29.995491 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:30.006689 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:30.017839 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:30.029021 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:12:30.146879 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:12:30.263711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:30.749596 run create_hlr_db(pid=24985): Launched 04:12:30.909840 bus /sierra_2: Setting Powered False 04:12:31.971471 run create_hlr_db(pid=24985): Terminated: ok {rc=0} 04:12:32.397774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24987): Launched 04:12:32.691630 run osmo-hlr_10.42.42.2(pid=24988): Launched 04:12:32.803652 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:33.323577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24990): Launched 04:12:33.616942 run osmo-stp_10.42.42.5(pid=24991): Launched 04:12:33.729159 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:34.259682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24993): Launched 04:12:34.553088 run osmo-msc_10.42.42.6(pid=24994): Launched 04:12:34.717350 run osmo-stp_10.42.42.5(pid=24991): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24991)] 04:12:34.842812 run osmo-stp_10.42.42.5(pid=24991): stdout: | (launched: 2022-12-10_04:12:33.563469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:34.968407 run osmo-stp_10.42.42.5(pid=24991): stderr: | 20221210041233734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041233734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041233734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041233735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041233735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041233735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041233735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:35.091798 run osmo-stp_10.42.42.5(pid=24991): stdout: | (launched: 2022-12-10_04:12:33.563469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:35.209196 run osmo-stp_10.42.42.5(pid=24991): stderr: | 20221210041233734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041233734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041233734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041233735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041233735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041233735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041233735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:35.351221 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24991): Process ended prematurely: osmo-stp_10.42.42.5(pid=24991) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24991)] [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:12:35.360232 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:12:35.387160 run osmo-hlr_10.42.42.2(pid=24988): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24988)] 04:12:35.434461 run osmo-hlr_10.42.42.2(pid=24988): stdout: | (launched: 2022-12-10_04:12:32.638176) 04:12:35.483464 run osmo-hlr_10.42.42.2(pid=24988): stderr: | 20221210041232812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041232813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041232813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041232813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041232813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041232813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041232825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041232834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041232834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041232834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:35.551523 run osmo-msc_10.42.42.6(pid=24994): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24994)] 04:12:35.598711 run osmo-msc_10.42.42.6(pid=24994): stdout: | (launched: 2022-12-10_04:12:34.499731) 04:12:35.647502 run osmo-msc_10.42.42.6(pid=24994): stderr: | 20221210041234770 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041234770 DLGLOBAL DEBUG validating counter group 0x7ff55f95ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041234770 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041234770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041234771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041234771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041234773 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041234773 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041234773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041234773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:35.696929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24987): Terminating (SIGTERM) 04:12:35.736155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24990): Terminating (SIGTERM) 04:12:35.775449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24993): Terminating (SIGTERM) 04:12:35.815214 --- ParallelTerminationStrategy: PID 24987 died... 04:12:35.834214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24987): Terminated: ok {rc=0} 04:12:35.878372 --- ParallelTerminationStrategy: PID 24990 died... 04:12:35.897338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24990): Terminated: ok {rc=0} 04:12:35.945270 --- ParallelTerminationStrategy: PID 24993 died... 04:12:35.964534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24993): Terminated: ok {rc=0} 04:12:36.050054 bus /sierra_3: Setting Powered False 04:12:37.147187 bus /sierra_3: Setting Powered False 04:12:38.261499 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:12:39.407976 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:39.419823 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:12:39.493484 tst mo_mt_call_osmux.py: using LAC 25907 04:12:39.616577 tst mo_mt_call_osmux.py: using RAC 152 04:12:39.737678 tst mo_mt_call_osmux.py: using CellId 25907 04:12:39.859654 tst mo_mt_call_osmux.py: using BVCI 25908 04:12:39.973498 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:39.984791 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:39.995983 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:40.007043 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:40.018159 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:12:40.029415 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:12:40.145592 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:12:40.265171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:40.751765 run create_hlr_db(pid=24997): Launched 04:12:40.880024 bus /sierra_2: Setting Powered False 04:12:41.943170 run create_hlr_db(pid=24997): Terminated: ok {rc=0} 04:12:42.380383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24999): Launched 04:12:42.692394 run osmo-hlr_10.42.42.2(pid=25000): Launched 04:12:42.812646 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:43.352645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25002): Launched 04:12:43.665239 run osmo-stp_10.42.42.5(pid=25003): Launched 04:12:43.785171 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:44.359172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25005): Launched 04:12:44.672748 run osmo-msc_10.42.42.6(pid=25006): Launched 04:12:44.848386 run osmo-stp_10.42.42.5(pid=25003): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25003)] 04:12:44.981267 run osmo-stp_10.42.42.5(pid=25003): stdout: | (launched: 2022-12-10_04:12:43.608529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:45.114759 run osmo-stp_10.42.42.5(pid=25003): stderr: | 20221210041243799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041243799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041243799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041243799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041243800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041243800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041243800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:45.247993 run osmo-stp_10.42.42.5(pid=25003): stdout: | (launched: 2022-12-10_04:12:43.608529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:45.373430 run osmo-stp_10.42.42.5(pid=25003): stderr: | 20221210041243799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041243799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041243799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041243799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041243800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041243800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041243800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:45.523949 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25003): Process ended prematurely: osmo-stp_10.42.42.5(pid=25003) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25003)] [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:12:45.533571 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:12:45.561310 run osmo-hlr_10.42.42.2(pid=25000): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25000)] 04:12:45.610974 run osmo-hlr_10.42.42.2(pid=25000): stdout: | (launched: 2022-12-10_04:12:42.635878) 04:12:45.662509 run osmo-hlr_10.42.42.2(pid=25000): stderr: | 20221210041242833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041242833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041242833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041242833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041242833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041242833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041242845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041242853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041242853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041242853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:45.734173 run osmo-msc_10.42.42.6(pid=25006): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25006)] 04:12:45.784197 run osmo-msc_10.42.42.6(pid=25006): stdout: | (launched: 2022-12-10_04:12:44.616042) 04:12:45.844772 run osmo-msc_10.42.42.6(pid=25006): stderr: | 20221210041244934 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041244935 DLGLOBAL DEBUG validating counter group 0x7f1259e11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041244935 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041244935 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041244935 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041244935 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041244937 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041244937 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041244937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041244937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:45.907780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24999): Terminating (SIGTERM) 04:12:45.956817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25002): Terminating (SIGTERM) 04:12:46.010065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25005): Terminating (SIGTERM) 04:12:46.055458 --- ParallelTerminationStrategy: PID 24999 died... 04:12:46.075354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24999): Terminated: ok {rc=0} 04:12:46.124298 --- ParallelTerminationStrategy: PID 25002 died... 04:12:46.144407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25002): Terminated: ok {rc=0} 04:12:46.191797 --- ParallelTerminationStrategy: PID 25005 died... 04:12:46.211398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25005): Terminated: ok {rc=0} 04:12:46.300313 bus /sierra_3: Setting Powered False 04:12:47.396589 bus /sierra_3: Setting Powered False 04:12:48.512430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:12:49.756596 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:49.762654 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:12:49.795176 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 04:12:49.821695 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 04:12:49.873407 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:12:49.906644 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 04:12:49.933844 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 04:12:50.483293 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 04:12:50.531037 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:12:50.542971 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:12:50.594205 tst mo_mt_call.py: using LAC 25908 04:12:50.716318 tst mo_mt_call.py: using RAC 153 04:12:50.830525 tst mo_mt_call.py: using CellId 25908 04:12:50.944285 tst mo_mt_call.py: using BVCI 25909 04:12:51.050770 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:12:51.062057 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:12:51.073068 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:12:51.084270 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:12:51.095647 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:12:51.106995 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:12:51.221651 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:12:51.335175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:51.790557 run create_hlr_db(pid=25011): Launched 04:12:51.902293 bus /sierra_2: Setting Powered False 04:12:52.961672 run create_hlr_db(pid=25011): Terminated: ok {rc=0} 04:12:53.371806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25013): Launched 04:12:53.664578 run osmo-hlr_10.42.42.2(pid=25014): Launched 04:12:53.776731 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:54.282644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25016): Launched 04:12:54.576454 run osmo-stp_10.42.42.5(pid=25017): Launched 04:12:54.689286 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:55.222581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25019): Launched 04:12:55.517722 run osmo-msc_10.42.42.6(pid=25020): Launched 04:12:55.682462 run osmo-stp_10.42.42.5(pid=25017): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25017)] 04:12:55.814097 run osmo-stp_10.42.42.5(pid=25017): stdout: | (launched: 2022-12-10_04:12:54.523009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:55.950687 run osmo-stp_10.42.42.5(pid=25017): stderr: | 20221210041254692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041254692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041254692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041254693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041254693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041254693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041254693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:56.090552 run osmo-stp_10.42.42.5(pid=25017): stdout: | (launched: 2022-12-10_04:12:54.523009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:56.215952 run osmo-stp_10.42.42.5(pid=25017): stderr: | 20221210041254692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041254692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041254692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041254693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041254693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041254693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041254693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:56.366477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25017): Process ended prematurely: osmo-stp_10.42.42.5(pid=25017) [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25017)] [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 04:12:56.376136 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 04:12:56.403926 run osmo-hlr_10.42.42.2(pid=25014): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25014)] 04:12:56.453668 run osmo-hlr_10.42.42.2(pid=25014): stdout: | (launched: 2022-12-10_04:12:53.611308) 04:12:56.505064 run osmo-hlr_10.42.42.2(pid=25014): stderr: | 20221210041253785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041253785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041253785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041253785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041253785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041253785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041253798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041253806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041253807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041253807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:56.576420 run osmo-msc_10.42.42.6(pid=25020): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25020)] 04:12:56.625925 run osmo-msc_10.42.42.6(pid=25020): stdout: | (launched: 2022-12-10_04:12:55.463857) 04:12:56.676792 run osmo-msc_10.42.42.6(pid=25020): stderr: | 20221210041255736 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041255736 DLGLOBAL DEBUG validating counter group 0x7f6cb771fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041255736 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041255736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041255737 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041255737 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041255738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041255739 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041255739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041255739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:56.727906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25013): Terminating (SIGTERM) 04:12:56.770067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25016): Terminating (SIGTERM) 04:12:56.811843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25019): Terminating (SIGTERM) 04:12:56.853859 --- ParallelTerminationStrategy: PID 25013 died... 04:12:56.873817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25013): Terminated: ok {rc=0} 04:12:56.920089 --- ParallelTerminationStrategy: PID 25016 died... 04:12:56.939684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25016): Terminated: ok {rc=0} 04:12:56.985633 --- ParallelTerminationStrategy: PID 25019 died... 04:12:57.005228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25019): Terminated: ok {rc=0} 04:12:57.092652 bus /sierra_3: Setting Powered False 04:12:58.192006 bus /sierra_3: Setting Powered False 04:12:59.306430 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 04:13:00.453142 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:00.465543 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:13:00.521939 tst mo_mt_call_osmux.py: using LAC 25909 04:13:00.643867 tst mo_mt_call_osmux.py: using RAC 154 04:13:00.767464 tst mo_mt_call_osmux.py: using CellId 25909 04:13:00.899982 tst mo_mt_call_osmux.py: using BVCI 25910 04:13:01.023710 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:01.036509 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:01.050735 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:01.063859 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:01.076660 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:01.089782 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:01.207384 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:01.338488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:01.843909 run create_hlr_db(pid=25022): Launched 04:13:01.987504 bus /sierra_2: Setting Powered False 04:13:03.049113 run create_hlr_db(pid=25022): Terminated: ok {rc=0} 04:13:03.469271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25024): Launched 04:13:03.763461 run osmo-hlr_10.42.42.2(pid=25025): Launched 04:13:03.874909 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:04.390774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25027): Launched 04:13:04.684873 run osmo-stp_10.42.42.5(pid=25028): Launched 04:13:04.796826 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:05.328633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25030): Launched 04:13:05.625385 run osmo-msc_10.42.42.6(pid=25032): Launched 04:13:05.792253 run osmo-stp_10.42.42.5(pid=25028): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25028)] 04:13:05.917435 run osmo-stp_10.42.42.5(pid=25028): stdout: | (launched: 2022-12-10_04:13:04.631040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:06.042678 run osmo-stp_10.42.42.5(pid=25028): stderr: | 20221210041304801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041304801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041304801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041304802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041304802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041304802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041304802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:06.165647 run osmo-stp_10.42.42.5(pid=25028): stdout: | (launched: 2022-12-10_04:13:04.631040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:06.283026 run osmo-stp_10.42.42.5(pid=25028): stderr: | 20221210041304801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041304801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041304801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041304802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041304802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041304802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041304802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:06.423234 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25028): Process ended prematurely: osmo-stp_10.42.42.5(pid=25028) [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25028)] [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 04:13:06.432218 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:13:06.459180 run osmo-hlr_10.42.42.2(pid=25025): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25025)] 04:13:06.506499 run osmo-hlr_10.42.42.2(pid=25025): stdout: | (launched: 2022-12-10_04:13:03.710450) 04:13:06.555466 run osmo-hlr_10.42.42.2(pid=25025): stderr: | 20221210041303887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041303887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041303887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041303887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041303887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041303887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041303899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041303907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041303907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041303907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:06.623756 run osmo-msc_10.42.42.6(pid=25032): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25032)] 04:13:06.671261 run osmo-msc_10.42.42.6(pid=25032): stdout: | (launched: 2022-12-10_04:13:05.569842) 04:13:06.720089 run osmo-msc_10.42.42.6(pid=25032): stderr: | 20221210041305839 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041305839 DLGLOBAL DEBUG validating counter group 0x7fbcb5327c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041305839 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041305840 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041305840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041305840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041305843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041305843 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041305843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041305843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:06.769508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25024): Terminating (SIGTERM) 04:13:06.809024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25027): Terminating (SIGTERM) 04:13:06.848374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25030): Terminating (SIGTERM) 04:13:06.888139 --- ParallelTerminationStrategy: PID 25024 died... 04:13:06.906938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25024): Terminated: ok {rc=0} 04:13:06.950653 --- ParallelTerminationStrategy: PID 25027 died... 04:13:06.968871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25027): Terminated: ok {rc=0} 04:13:07.012931 --- ParallelTerminationStrategy: PID 25030 died... 04:13:07.031715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25030): Terminated: ok {rc=0} 04:13:07.117467 bus /sierra_3: Setting Powered False 04:13:08.215535 bus /sierra_3: Setting Powered False 04:13:09.327811 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:trx-umtrx --------------------------------------------------------------------- 04:13:10.577423 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:10.582195 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:13:10.615130 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:13:10.642447 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 04:13:10.728196 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:13:10.761617 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:13:10.788708 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 04:13:11.374259 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 04:13:11.379403 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:11.390583 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 04:13:11.439232 tst emergency_mo_mt_call.py: using LAC 25910 04:13:11.559704 tst emergency_mo_mt_call.py: using RAC 155 04:13:11.679856 tst emergency_mo_mt_call.py: using CellId 25910 04:13:11.800808 tst emergency_mo_mt_call.py: using BVCI 25911 04:13:11.913888 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:11.924854 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:11.935740 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:11.946686 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:11.957555 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:11.968637 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:12.086145 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:12.201343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:12.649567 run create_hlr_db(pid=25037): Launched 04:13:12.760384 bus /sierra_2: Setting Powered False 04:13:13.818980 run create_hlr_db(pid=25037): Terminated: ok {rc=0} 04:13:14.223155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25039): Launched 04:13:14.512301 run osmo-hlr_10.42.42.2(pid=25040): Launched 04:13:14.622889 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:15.118896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25042): Launched 04:13:15.407766 run osmo-stp_10.42.42.5(pid=25043): Launched 04:13:15.528722 tst emergency_mo_mt_call.py: using MSISDN 7545 04:13:15.687978 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:16.253812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25045): Launched 04:13:16.584314 run osmo-msc_10.42.42.6(pid=25046): Launched 04:13:16.900693 run osmo-stp_10.42.42.5(pid=25043): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25043)] 04:13:17.228584 run osmo-stp_10.42.42.5(pid=25043): stdout: | (launched: 2022-12-10_04:13:15.354535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:17.386084 run osmo-stp_10.42.42.5(pid=25043): stderr: | 20221210041315527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041315527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041315527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041315528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041315528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041315528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041315528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:17.515561 run osmo-stp_10.42.42.5(pid=25043): stdout: | (launched: 2022-12-10_04:13:15.354535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:17.639076 run osmo-stp_10.42.42.5(pid=25043): stderr: | 20221210041315527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041315527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041315527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041315528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041315528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041315528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041315528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:17.786947 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25043): Process ended prematurely: osmo-stp_10.42.42.5(pid=25043) [trial-2369↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25043)] [trial-2369↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 04:13:17.795900 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 04:13:17.823331 run osmo-hlr_10.42.42.2(pid=25040): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25040)] 04:13:17.873139 run osmo-hlr_10.42.42.2(pid=25040): stdout: | (launched: 2022-12-10_04:13:14.459106) 04:13:17.924081 run osmo-hlr_10.42.42.2(pid=25040): stderr: | 20221210041314633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041314634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041314634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041314634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041314634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041314634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041314646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041314654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041314654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041314654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:17.995529 run osmo-msc_10.42.42.6(pid=25046): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25046)] 04:13:18.044891 run osmo-msc_10.42.42.6(pid=25046): stdout: | (launched: 2022-12-10_04:13:16.521972) 04:13:18.095768 run osmo-msc_10.42.42.6(pid=25046): stderr: | 20221210041317068 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041317068 DLGLOBAL DEBUG validating counter group 0x7faea02e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041317068 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041317068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041317068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041317068 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041317070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041317071 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041317071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041317071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:18.146821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25039): Terminating (SIGTERM) 04:13:18.187842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25042): Terminating (SIGTERM) 04:13:18.228804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25045): Terminating (SIGTERM) 04:13:18.270449 --- ParallelTerminationStrategy: PID 25039 died... 04:13:18.290039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25039): Terminated: ok {rc=0} 04:13:18.335403 --- ParallelTerminationStrategy: PID 25042 died... 04:13:18.354729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25042): Terminated: ok {rc=0} 04:13:18.399898 --- ParallelTerminationStrategy: PID 25045 died... 04:13:18.419107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25045): Terminated: ok {rc=0} 04:13:18.505344 bus /sierra_3: Setting Powered False 04:13:19.602377 bus /sierra_3: Setting Powered False 04:13:20.718391 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 04:13:21.803784 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:21.815614 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 04:13:21.866448 tst emergency_preemptive_call.py: using LAC 25911 04:13:21.986759 tst emergency_preemptive_call.py: using RAC 156 04:13:22.107953 tst emergency_preemptive_call.py: using CellId 25911 04:13:22.231020 tst emergency_preemptive_call.py: using BVCI 25912 04:13:22.342772 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:22.354015 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:22.365048 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:22.375944 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:22.386858 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:22.397933 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:22.511484 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:22.624629 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:22.736649 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:22.852550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:23.332415 run create_hlr_db(pid=25048): Launched 04:13:23.457726 bus /sierra_2: Setting Powered False 04:13:24.520045 run create_hlr_db(pid=25048): Terminated: ok {rc=0} 04:13:24.934548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25050): Launched 04:13:25.225437 run osmo-hlr_10.42.42.2(pid=25051): Launched 04:13:25.335830 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:25.849472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25053): Launched 04:13:26.138906 run osmo-stp_10.42.42.5(pid=25054): Launched 04:13:26.258935 tst emergency_preemptive_call.py: using MSISDN 7546 04:13:26.420282 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:26.939459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25056): Launched 04:13:27.228679 run osmo-msc_10.42.42.6(pid=25057): Launched 04:13:27.391683 run osmo-stp_10.42.42.5(pid=25054): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25054)] 04:13:27.518092 run osmo-stp_10.42.42.5(pid=25054): stdout: | (launched: 2022-12-10_04:13:26.086169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:27.642210 run osmo-stp_10.42.42.5(pid=25054): stderr: | 20221210041326255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041326255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041326255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041326256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041326257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041326257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041326257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:27.764242 run osmo-stp_10.42.42.5(pid=25054): stdout: | (launched: 2022-12-10_04:13:26.086169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:27.881077 run osmo-stp_10.42.42.5(pid=25054): stderr: | 20221210041326255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041326255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041326255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041326256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041326257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041326257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041326257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:28.019560 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25054): Process ended prematurely: osmo-stp_10.42.42.5(pid=25054) [trial-2369↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25054)] [trial-2369↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 04:13:28.028259 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 04:13:28.054736 run osmo-hlr_10.42.42.2(pid=25051): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25051)] 04:13:28.102230 run osmo-hlr_10.42.42.2(pid=25051): stdout: | (launched: 2022-12-10_04:13:25.171893) 04:13:28.151319 run osmo-hlr_10.42.42.2(pid=25051): stderr: | 20221210041325345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041325346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041325346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041325346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041325346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041325346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041325359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041325369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041325369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041325369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:28.219475 run osmo-msc_10.42.42.6(pid=25057): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25057)] 04:13:28.266651 run osmo-msc_10.42.42.6(pid=25057): stdout: | (launched: 2022-12-10_04:13:27.175474) 04:13:28.315398 run osmo-msc_10.42.42.6(pid=25057): stderr: | 20221210041327446 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041327447 DLGLOBAL DEBUG validating counter group 0x7efc912f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041327447 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041327447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041327447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041327447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041327449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041327449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041327450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041327450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:28.365213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25050): Terminating (SIGTERM) 04:13:28.404644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25053): Terminating (SIGTERM) 04:13:28.444162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25056): Terminating (SIGTERM) 04:13:28.483971 --- ParallelTerminationStrategy: PID 25050 died... 04:13:28.502927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25050): Terminated: ok {rc=0} 04:13:28.546854 --- ParallelTerminationStrategy: PID 25053 died... 04:13:28.565473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25053): Terminated: ok {rc=0} 04:13:28.609173 --- ParallelTerminationStrategy: PID 25056 died... 04:13:28.627464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25056): Terminated: ok {rc=0} 04:13:28.711232 bus /sierra_9: Setting Powered False 04:13:29.809441 bus /sierra_9: Setting Powered False 04:13:30.942517 bus /sierra_8: Setting Powered False 04:13:32.061321 bus /sierra_8: Setting Powered False 04:13:33.190482 bus /sierra_3: Setting Powered False 04:13:34.286939 bus /sierra_3: Setting Powered False 04:13:35.403065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx --------------------------------------------------------------------- 04:13:36.681450 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:36.686810 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:13:36.719939 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 04:13:36.759331 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 04:13:36.846548 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:13:36.879292 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 04:13:36.918251 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 04:13:37.511166 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 04:13:37.562861 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:37.573949 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:13:37.621620 tst cs_paging_gprs_active.py: using LAC 25912 04:13:37.736332 tst cs_paging_gprs_active.py: using RAC 157 04:13:37.850271 tst cs_paging_gprs_active.py: using CellId 25912 04:13:37.964402 tst cs_paging_gprs_active.py: using BVCI 25913 04:13:38.071079 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.081852 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.092394 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.102991 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.113529 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.124756 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.135720 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.146382 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:38.156866 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:38.274991 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:38.390120 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:13:38.589678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:13:38.885111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25062): Launched 04:13:39.141288 run iperf3-srv_10.42.42.10(pid=25063): Launched 04:13:39.251994 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:13:39.450636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:13:39.747132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25064): Launched 04:13:40.003809 run iperf3-srv_10.42.42.10(pid=25065): Launched 04:13:40.114539 tst cs_paging_gprs_active.py:38: start network... 04:13:40.312512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:40.769385 run create_hlr_db(pid=25067): Launched 04:13:40.882265 bus /sierra_2: Setting Powered False 04:13:41.942851 run create_hlr_db(pid=25067): Terminated: ok {rc=0} 04:13:42.374418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25069): Launched 04:13:42.689667 run osmo-hlr_10.42.42.2(pid=25070): Launched 04:13:42.810633 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:43.353692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25072): Launched 04:13:43.669412 run osmo-stp_10.42.42.5(pid=25073): Launched 04:13:43.790653 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:13:44.334016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25075): Launched 04:13:44.454490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:13:44.719851 run patchelf(pid=25076): Launched 04:13:44.895536 run osmo-stp_10.42.42.5(pid=25073): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25073)] 04:13:45.029049 run osmo-stp_10.42.42.5(pid=25073): stdout: | (launched: 2022-12-10_04:13:43.611543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:45.164634 run osmo-stp_10.42.42.5(pid=25073): stderr: | 20221210041343802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041343802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041343802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041343803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041343805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041343805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041343805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:45.299964 run osmo-stp_10.42.42.5(pid=25073): stdout: | (launched: 2022-12-10_04:13:43.611543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:45.429392 run osmo-stp_10.42.42.5(pid=25073): stderr: | 20221210041343802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041343802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041343802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041343803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041343805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041343805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041343805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:45.582651 run patchelf(pid=25076): Terminating (SIGINT) 04:13:45.759762 run patchelf(pid=25076): Terminated: ok {rc=0} 04:13:45.910116 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25073): Process ended prematurely: osmo-stp_10.42.42.5(pid=25073) [trial-2369↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25073)] [trial-2369↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 04:13:45.924226 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 04:13:45.953526 run osmo-hlr_10.42.42.2(pid=25070): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25070)] 04:13:46.003535 run osmo-hlr_10.42.42.2(pid=25070): stdout: | (launched: 2022-12-10_04:13:42.632229) 04:13:46.057422 run osmo-hlr_10.42.42.2(pid=25070): stderr: | 20221210041342828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041342828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041342828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041342828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041342828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041342828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041342839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041342848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041342848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041342848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:46.109596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25062): Terminating (SIGTERM) 04:13:46.152079 run iperf3-srv_10.42.42.10(pid=25063): Terminating (SIGTERM) 04:13:46.196791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25064): Terminating (SIGTERM) 04:13:46.239437 run iperf3-srv_10.42.42.10(pid=25065): Terminating (SIGTERM) 04:13:46.284067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25069): Terminating (SIGTERM) 04:13:46.326900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25072): Terminating (SIGTERM) 04:13:46.371011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25075): Terminating (SIGTERM) 04:13:46.415471 --- ParallelTerminationStrategy: PID 25062 died... 04:13:46.435529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25062): Terminated: ok {rc=0} 04:13:46.482174 --- ParallelTerminationStrategy: PID 25063 died... 04:13:46.502135 run iperf3-srv_10.42.42.10(pid=25063): Terminated {rc=256} 04:13:46.548812 --- ParallelTerminationStrategy: PID 25064 died... 04:13:46.568866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25064): Terminated: ok {rc=0} 04:13:46.615699 --- ParallelTerminationStrategy: PID 25065 died... 04:13:46.635587 run iperf3-srv_10.42.42.10(pid=25065): Terminated {rc=256} 04:13:46.681909 --- ParallelTerminationStrategy: PID 25069 died... 04:13:46.701652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25069): Terminated: ok {rc=0} 04:13:46.748203 --- ParallelTerminationStrategy: PID 25072 died... 04:13:46.768303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25072): Terminated: ok {rc=0} 04:13:46.814904 --- ParallelTerminationStrategy: PID 25075 died... 04:13:46.834918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25075): Terminated: ok {rc=0} 04:13:46.935383 bus /gobi_0: Setting Powered False 04:13:48.041289 bus /gobi_0: Setting Powered False 04:13:49.155098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx iperf3.py ---------------------------------------------- 04:13:50.302401 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.314011 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:13:50.365380 tst iperf3.py: using LAC 25913 04:13:50.488745 tst iperf3.py: using RAC 158 04:13:50.620503 tst iperf3.py: using CellId 25913 04:13:50.754021 tst iperf3.py: using BVCI 25914 04:13:50.870901 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.882024 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.892779 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.903626 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.914293 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.925005 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.935864 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.946661 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:50.957585 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:51.072021 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:13:51.272833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:13:51.570539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25077): Launched 04:13:51.828938 run iperf3-srv_10.42.42.10(pid=25078): Launched 04:13:51.940652 tst iperf3.py:8: start network... 04:13:52.140383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:52.598688 run create_hlr_db(pid=25079): Launched 04:13:52.710954 bus /gobi_6: Setting Powered False 04:13:53.769652 run create_hlr_db(pid=25079): Terminated: ok {rc=0} 04:13:54.201491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25081): Launched 04:13:54.515690 run osmo-hlr_10.42.42.2(pid=25082): Launched 04:13:54.637254 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:55.182647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25084): Launched 04:13:55.495720 run osmo-stp_10.42.42.5(pid=25085): Launched 04:13:55.616331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:13:56.159903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25087): Launched 04:13:56.280325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:13:56.545618 run patchelf(pid=25088): Launched 04:13:56.719715 run osmo-stp_10.42.42.5(pid=25085): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25085)] 04:13:56.854024 run osmo-stp_10.42.42.5(pid=25085): stdout: | (launched: 2022-12-10_04:13:55.438660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:56.989368 run osmo-stp_10.42.42.5(pid=25085): stderr: | 20221210041355630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041355630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041355630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041355631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041355631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041355631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041355631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:57.125031 run osmo-stp_10.42.42.5(pid=25085): stdout: | (launched: 2022-12-10_04:13:55.438660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:57.254564 run osmo-stp_10.42.42.5(pid=25085): stderr: | 20221210041355630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041355630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041355630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041355631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041355631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041355631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041355631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:57.408123 run patchelf(pid=25088): Terminating (SIGINT) 04:13:57.584538 run patchelf(pid=25088): Terminated: ok {rc=0} 04:13:57.712292 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25085): Process ended prematurely: osmo-stp_10.42.42.5(pid=25085) [trial-2369↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25085)] [trial-2369↪gprs:trx-umtrx↪iperf3.py:8] 04:13:57.722540 tst iperf3.py:8: Test FAILED (7.5 sec) 04:13:57.750829 run osmo-hlr_10.42.42.2(pid=25082): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25082)] 04:13:57.800116 run osmo-hlr_10.42.42.2(pid=25082): stdout: | (launched: 2022-12-10_04:13:54.459031) 04:13:57.850637 run osmo-hlr_10.42.42.2(pid=25082): stderr: | 20221210041354657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041354657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041354657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041354657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041354657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041354657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041354670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041354678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041354678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041354678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:57.901419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25077): Terminating (SIGTERM) 04:13:57.942261 run iperf3-srv_10.42.42.10(pid=25078): Terminating (SIGTERM) 04:13:57.982954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25081): Terminating (SIGTERM) 04:13:58.023769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25084): Terminating (SIGTERM) 04:13:58.064506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25087): Terminating (SIGTERM) 04:13:58.105730 --- ParallelTerminationStrategy: PID 25077 died... 04:13:58.125311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25077): Terminated: ok {rc=0} 04:13:58.170603 --- ParallelTerminationStrategy: PID 25078 died... 04:13:58.189538 run iperf3-srv_10.42.42.10(pid=25078): Terminated {rc=256} 04:13:58.234559 --- ParallelTerminationStrategy: PID 25081 died... 04:13:58.253616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25081): Terminated: ok {rc=0} 04:13:58.298551 --- ParallelTerminationStrategy: PID 25084 died... 04:13:58.317767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25084): Terminated: ok {rc=0} 04:13:58.362753 --- ParallelTerminationStrategy: PID 25087 died... 04:13:58.381874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25087): Terminated: ok {rc=0} 04:13:58.467472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 04:13:59.613012 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:13:59.624412 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:13:59.673854 tst iperf3m4.py: using LAC 25914 04:13:59.799268 tst iperf3m4.py: using RAC 159 04:13:59.922750 tst iperf3m4.py: using CellId 25914 04:14:00.047763 tst iperf3m4.py: using BVCI 25915 04:14:00.161874 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.172939 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.184276 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.195154 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.205954 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.217148 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.228083 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.238980 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:00.250022 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:00.364488 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:00.487871 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:00.605404 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:00.722450 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:14:00.961541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:01.298665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25089): Launched 04:14:01.589214 run iperf3-srv_10.42.42.10(pid=25090): Launched 04:14:01.721772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:14:01.940267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:02.259258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25091): Launched 04:14:02.534198 run iperf3-srv_10.42.42.10(pid=25092): Launched 04:14:02.652216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:14:02.866105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:03.182139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25093): Launched 04:14:03.454698 run iperf3-srv_10.42.42.10(pid=25094): Launched 04:14:03.572288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:14:03.786563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:04.103132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25095): Launched 04:14:04.376862 run iperf3-srv_10.42.42.10(pid=25096): Launched 04:14:04.494684 tst iperf3m4.py:8: start network... 04:14:04.707255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:05.195821 run create_hlr_db(pid=25097): Launched 04:14:05.323475 bus /gobi_6: Setting Powered False 04:14:06.386184 run create_hlr_db(pid=25097): Terminated: ok {rc=0} 04:14:06.824808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25099): Launched 04:14:07.139477 run osmo-hlr_10.42.42.2(pid=25100): Launched 04:14:07.258858 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:07.802342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25102): Launched 04:14:08.116725 run osmo-stp_10.42.42.5(pid=25103): Launched 04:14:08.236396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:08.779053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25105): Launched 04:14:08.900431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:09.166107 run patchelf(pid=25106): Launched 04:14:09.341254 run osmo-stp_10.42.42.5(pid=25103): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25103)] 04:14:09.475710 run osmo-stp_10.42.42.5(pid=25103): stdout: | (launched: 2022-12-10_04:14:08.059571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:09.611425 run osmo-stp_10.42.42.5(pid=25103): stderr: | 20221210041408249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041408249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041408250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041408250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041408250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041408250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041408251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:09.747065 run osmo-stp_10.42.42.5(pid=25103): stdout: | (launched: 2022-12-10_04:14:08.059571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:09.877548 run osmo-stp_10.42.42.5(pid=25103): stderr: | 20221210041408249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041408249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041408250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041408250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041408250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041408250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041408251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:10.030931 run patchelf(pid=25106): Terminating (SIGINT) 04:14:10.207814 run patchelf(pid=25106): Terminated: ok {rc=0} 04:14:10.335778 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25103): Process ended prematurely: osmo-stp_10.42.42.5(pid=25103) [trial-2369↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25103)] [trial-2369↪gprs:trx-umtrx↪iperf3m4.py:8] 04:14:10.346121 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:14:10.374297 run osmo-hlr_10.42.42.2(pid=25100): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25100)] 04:14:10.422968 run osmo-hlr_10.42.42.2(pid=25100): stdout: | (launched: 2022-12-10_04:14:07.082385) 04:14:10.473319 run osmo-hlr_10.42.42.2(pid=25100): stderr: | 20221210041407279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041407279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041407279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041407279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041407279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041407279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041407291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041407300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041407300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041407300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:10.523999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25089): Terminating (SIGTERM) 04:14:10.564842 run iperf3-srv_10.42.42.10(pid=25090): Terminating (SIGTERM) 04:14:10.606005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25091): Terminating (SIGTERM) 04:14:10.647325 run iperf3-srv_10.42.42.10(pid=25092): Terminating (SIGTERM) 04:14:10.688324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25093): Terminating (SIGTERM) 04:14:10.729400 run iperf3-srv_10.42.42.10(pid=25094): Terminating (SIGTERM) 04:14:10.770206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25095): Terminating (SIGTERM) 04:14:10.811471 run iperf3-srv_10.42.42.10(pid=25096): Terminating (SIGTERM) 04:14:10.852420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25099): Terminating (SIGTERM) 04:14:10.893375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25102): Terminating (SIGTERM) 04:14:10.934376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25105): Terminating (SIGTERM) 04:14:10.975788 --- ParallelTerminationStrategy: PID 25089 died... 04:14:10.995632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25089): Terminated: ok {rc=0} 04:14:11.041458 --- ParallelTerminationStrategy: PID 25090 died... 04:14:11.060940 run iperf3-srv_10.42.42.10(pid=25090): Terminated {rc=256} 04:14:11.106618 --- ParallelTerminationStrategy: PID 25091 died... 04:14:11.126129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25091): Terminated: ok {rc=0} 04:14:11.171886 --- ParallelTerminationStrategy: PID 25092 died... 04:14:11.191469 run iperf3-srv_10.42.42.10(pid=25092): Terminated {rc=256} 04:14:11.236923 --- ParallelTerminationStrategy: PID 25093 died... 04:14:11.256451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25093): Terminated: ok {rc=0} 04:14:11.302168 --- ParallelTerminationStrategy: PID 25094 died... 04:14:11.321500 run iperf3-srv_10.42.42.10(pid=25094): Terminated {rc=256} 04:14:11.367333 --- ParallelTerminationStrategy: PID 25095 died... 04:14:11.386838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25095): Terminated: ok {rc=0} 04:14:11.432643 --- ParallelTerminationStrategy: PID 25096 died... 04:14:11.452152 run iperf3-srv_10.42.42.10(pid=25096): Terminated {rc=256} 04:14:11.497847 --- ParallelTerminationStrategy: PID 25099 died... 04:14:11.517412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25099): Terminated: ok {rc=0} 04:14:11.563123 --- ParallelTerminationStrategy: PID 25102 died... 04:14:11.582697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25102): Terminated: ok {rc=0} 04:14:11.628346 --- ParallelTerminationStrategy: PID 25105 died... 04:14:11.647804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25105): Terminated: ok {rc=0} 04:14:11.734456 bus /gobi_4: Setting Powered False 04:14:12.830651 bus /gobi_4: Setting Powered False 04:14:13.945749 bus /gobi_1: Setting Powered False 04:14:15.042876 bus /gobi_1: Setting Powered False 04:14:16.159431 bus /gobi_0: Setting Powered False 04:14:17.257279 bus /gobi_0: Setting Powered False 04:14:18.372735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx ping.py ---------------------------------------------- 04:14:19.474140 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:19.485748 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:19.535553 tst ping.py: using LAC 25915 04:14:19.657406 tst ping.py: using RAC 160 04:14:19.779283 tst ping.py: using CellId 25915 04:14:19.901456 tst ping.py: using BVCI 25916 04:14:20.014044 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:20.025221 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:20.036286 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:20.047539 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:20.058642 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:20.069866 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:20.081207 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:20.092438 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:20.206298 tst ping.py:19: start network... 04:14:20.400887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:20.849972 run create_hlr_db(pid=25107): Launched 04:14:20.960698 bus /gobi_6: Setting Powered False 04:14:22.018679 run create_hlr_db(pid=25107): Terminated: ok {rc=0} 04:14:22.441550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25109): Launched 04:14:22.749278 run osmo-hlr_10.42.42.2(pid=25110): Launched 04:14:22.868200 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:23.406925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25112): Launched 04:14:23.715564 run osmo-stp_10.42.42.5(pid=25113): Launched 04:14:23.833631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:24.367558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25115): Launched 04:14:24.486103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:24.747836 run patchelf(pid=25116): Launched 04:14:24.920546 run osmo-stp_10.42.42.5(pid=25113): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25113)] 04:14:25.052661 run osmo-stp_10.42.42.5(pid=25113): stdout: | (launched: 2022-12-10_04:14:23.659561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:25.185924 run osmo-stp_10.42.42.5(pid=25113): stderr: | 20221210041423850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041423850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041423850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041423850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041423851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041423851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041423851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:25.319479 run osmo-stp_10.42.42.5(pid=25113): stdout: | (launched: 2022-12-10_04:14:23.659561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:25.446957 run osmo-stp_10.42.42.5(pid=25113): stderr: | 20221210041423850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041423850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041423850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041423850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041423851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041423851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041423851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:25.597997 run patchelf(pid=25116): Terminating (SIGINT) 04:14:25.772228 run patchelf(pid=25116): Terminated: ok {rc=0} 04:14:25.898808 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25113): Process ended prematurely: osmo-stp_10.42.42.5(pid=25113) [trial-2369↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25113)] [trial-2369↪gprs:trx-umtrx↪ping.py:22] 04:14:25.908345 tst ping.py:22: Test FAILED (6.4 sec) 04:14:25.936556 run osmo-hlr_10.42.42.2(pid=25110): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25110)] 04:14:25.985856 run osmo-hlr_10.42.42.2(pid=25110): stdout: | (launched: 2022-12-10_04:14:22.693247) 04:14:26.036846 run osmo-hlr_10.42.42.2(pid=25110): stderr: | 20221210041422891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041422891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041422891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041422891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041422891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041422891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041422904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041422912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041422913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041422913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:26.088071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25109): Terminating (SIGTERM) 04:14:26.129388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25112): Terminating (SIGTERM) 04:14:26.170663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25115): Terminating (SIGTERM) 04:14:26.212174 --- ParallelTerminationStrategy: PID 25109 died... 04:14:26.231950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25109): Terminated: ok {rc=0} 04:14:26.277466 --- ParallelTerminationStrategy: PID 25112 died... 04:14:26.297199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25112): Terminated: ok {rc=0} 04:14:26.342380 --- ParallelTerminationStrategy: PID 25115 died... 04:14:26.361657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25115): Terminated: ok {rc=0} 04:14:26.449003 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 04:14:27.536142 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:27.548228 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:27.599325 tst ping_idle_ping.py: using LAC 25916 04:14:27.721903 tst ping_idle_ping.py: using RAC 161 04:14:27.844171 tst ping_idle_ping.py: using CellId 25916 04:14:27.967836 tst ping_idle_ping.py: using BVCI 25917 04:14:28.080486 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:28.091613 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:28.102622 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:28.113613 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:28.124507 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:28.135395 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:28.146454 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:28.157447 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:28.270650 tst ping_idle_ping.py:24: start network... 04:14:28.467489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:28.921112 run create_hlr_db(pid=25117): Launched 04:14:29.032650 bus /gobi_6: Setting Powered False 04:14:30.091485 run create_hlr_db(pid=25117): Terminated: ok {rc=0} 04:14:30.499295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25119): Launched 04:14:30.790676 run osmo-hlr_10.42.42.2(pid=25120): Launched 04:14:31.005064 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:31.599215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25122): Launched 04:14:31.923951 run osmo-stp_10.42.42.5(pid=25123): Launched 04:14:32.160707 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:32.767238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25125): Launched 04:14:32.886551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:33.149127 run patchelf(pid=25126): Launched 04:14:33.322485 run osmo-stp_10.42.42.5(pid=25123): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25123)] 04:14:33.454785 run osmo-stp_10.42.42.5(pid=25123): stdout: | (launched: 2022-12-10_04:14:31.858466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:33.587922 run osmo-stp_10.42.42.5(pid=25123): stderr: | 20221210041432156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041432156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041432157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041432157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041432158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041432158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041432158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:33.721348 run osmo-stp_10.42.42.5(pid=25123): stdout: | (launched: 2022-12-10_04:14:31.858466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:33.849458 run osmo-stp_10.42.42.5(pid=25123): stderr: | 20221210041432156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041432156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041432157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041432157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041432158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041432158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041432158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:34.000635 run patchelf(pid=25126): Terminating (SIGINT) 04:14:34.174982 run patchelf(pid=25126): Terminated: ok {rc=0} 04:14:34.300254 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25123): Process ended prematurely: osmo-stp_10.42.42.5(pid=25123) [trial-2369↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25123)] [trial-2369↪gprs:trx-umtrx↪ping_idle_ping.py:27] 04:14:34.309921 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 04:14:34.337681 run osmo-hlr_10.42.42.2(pid=25120): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25120)] 04:14:34.386948 run osmo-hlr_10.42.42.2(pid=25120): stdout: | (launched: 2022-12-10_04:14:30.737766) 04:14:34.438558 run osmo-hlr_10.42.42.2(pid=25120): stderr: | 20221210041430996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041430997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041430997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041430997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041430997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041430997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041431015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041431028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041431028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041431028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:34.490110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25119): Terminating (SIGTERM) 04:14:34.531316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25122): Terminating (SIGTERM) 04:14:34.572747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25125): Terminating (SIGTERM) 04:14:34.614957 --- ParallelTerminationStrategy: PID 25119 died... 04:14:34.634922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25119): Terminated: ok {rc=0} 04:14:34.680915 --- ParallelTerminationStrategy: PID 25122 died... 04:14:34.700425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25122): Terminated: ok {rc=0} 04:14:34.746048 --- ParallelTerminationStrategy: PID 25125 died... 04:14:34.765437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25125): Terminated: ok {rc=0} 04:14:34.852274 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 04:14:36.148814 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:14:36.154418 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:14:36.187015 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:14:36.225845 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:14:36.311533 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:14:36.343715 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:14:36.381968 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:14:36.974518 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:14:37.022930 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.033913 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:14:37.082758 tst cs_paging_gprs_active.py: using LAC 25917 04:14:37.200062 tst cs_paging_gprs_active.py: using RAC 162 04:14:37.317143 tst cs_paging_gprs_active.py: using CellId 25917 04:14:37.441436 tst cs_paging_gprs_active.py: using BVCI 25918 04:14:37.556617 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.568116 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.579369 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.590759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.602032 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.613087 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.624296 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.635315 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:37.646635 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:14:37.765343 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:14:37.882680 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:14:38.097700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:38.416505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25130): Launched 04:14:38.690918 run iperf3-srv_10.42.42.10(pid=25131): Launched 04:14:38.809920 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:14:39.023959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:39.341360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25132): Launched 04:14:39.615126 run iperf3-srv_10.42.42.10(pid=25133): Launched 04:14:39.733478 tst cs_paging_gprs_active.py:38: start network... 04:14:39.947448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:40.437651 run create_hlr_db(pid=25134): Launched 04:14:40.566853 bus /gobi_6: Setting Powered False 04:14:41.629471 run create_hlr_db(pid=25134): Terminated: ok {rc=0} 04:14:42.070566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Launched 04:14:42.386255 run osmo-hlr_10.42.42.2(pid=25137): Launched 04:14:42.506097 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:43.048443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Launched 04:14:43.363242 run osmo-stp_10.42.42.5(pid=25140): Launched 04:14:43.483312 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:44.026424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25142): Launched 04:14:44.147205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:44.413049 run patchelf(pid=25143): Launched 04:14:44.588251 run osmo-stp_10.42.42.5(pid=25140): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] 04:14:44.722191 run osmo-stp_10.42.42.5(pid=25140): stdout: | (launched: 2022-12-10_04:14:43.306227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:44.858357 run osmo-stp_10.42.42.5(pid=25140): stderr: | 20221210041443499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041443499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041443499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041443499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041443500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041443500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041443500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:44.993910 run osmo-stp_10.42.42.5(pid=25140): stdout: | (launched: 2022-12-10_04:14:43.306227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:45.123527 run osmo-stp_10.42.42.5(pid=25140): stderr: | 20221210041443499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041443499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041443499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041443499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041443500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041443500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041443500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:45.276440 run patchelf(pid=25143): Terminating (SIGINT) 04:14:45.454056 run patchelf(pid=25143): Terminated: ok {rc=0} 04:14:45.581670 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25140): Process ended prematurely: osmo-stp_10.42.42.5(pid=25140) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:14:45.591912 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:14:45.620257 run osmo-hlr_10.42.42.2(pid=25137): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25137)] 04:14:45.669062 run osmo-hlr_10.42.42.2(pid=25137): stdout: | (launched: 2022-12-10_04:14:42.329333) 04:14:45.719762 run osmo-hlr_10.42.42.2(pid=25137): stderr: | 20221210041442527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041442527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041442527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041442527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041442527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041442527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041442540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041442548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041442549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041442549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:45.770880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25130): Terminating (SIGTERM) 04:14:45.812416 run iperf3-srv_10.42.42.10(pid=25131): Terminating (SIGTERM) 04:14:45.864058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25132): Terminating (SIGTERM) 04:14:45.906168 run iperf3-srv_10.42.42.10(pid=25133): Terminating (SIGTERM) 04:14:45.947877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Terminating (SIGTERM) 04:14:45.989959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Terminating (SIGTERM) 04:14:46.031572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25142): Terminating (SIGTERM) 04:14:46.074046 --- ParallelTerminationStrategy: PID 25130 died... 04:14:46.094240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25130): Terminated: ok {rc=0} 04:14:46.142118 --- ParallelTerminationStrategy: PID 25131 died... 04:14:46.161855 run iperf3-srv_10.42.42.10(pid=25131): Terminated {rc=256} 04:14:46.208148 --- ParallelTerminationStrategy: PID 25132 died... 04:14:46.227985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25132): Terminated: ok {rc=0} 04:14:46.274193 --- ParallelTerminationStrategy: PID 25133 died... 04:14:46.293944 run iperf3-srv_10.42.42.10(pid=25133): Terminated {rc=256} 04:14:46.340135 --- ParallelTerminationStrategy: PID 25136 died... 04:14:46.359937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Terminated: ok {rc=0} 04:14:46.406768 --- ParallelTerminationStrategy: PID 25139 died... 04:14:46.426971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Terminated: ok {rc=0} 04:14:46.474302 --- ParallelTerminationStrategy: PID 25142 died... 04:14:46.494505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25142): Terminated: ok {rc=0} 04:14:46.587250 bus /gobi_0: Setting Powered False 04:14:47.696489 bus /gobi_0: Setting Powered False 04:14:48.811857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:14:49.961951 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:49.973941 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:14:50.027384 tst iperf3.py: using LAC 25918 04:14:50.152455 tst iperf3.py: using RAC 163 04:14:50.276437 tst iperf3.py: using CellId 25918 04:14:50.403696 tst iperf3.py: using BVCI 25919 04:14:50.519749 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.531180 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.542256 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.553504 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.564537 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.575593 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.586863 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.597890 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:50.609168 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:14:50.722562 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:14:50.922775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:51.221571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25144): Launched 04:14:51.478728 run iperf3-srv_10.42.42.10(pid=25145): Launched 04:14:51.590181 tst iperf3.py:8: start network... 04:14:51.789285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:52.247248 run create_hlr_db(pid=25146): Launched 04:14:52.360490 bus /gobi_6: Setting Powered False 04:14:53.420378 run create_hlr_db(pid=25146): Terminated: ok {rc=0} 04:14:53.851607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25148): Launched 04:14:54.166827 run osmo-hlr_10.42.42.2(pid=25149): Launched 04:14:54.287233 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:54.836145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25151): Launched 04:14:55.151117 run osmo-stp_10.42.42.5(pid=25152): Launched 04:14:55.271073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:55.814032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25154): Launched 04:14:55.934202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:56.200198 run patchelf(pid=25155): Launched 04:14:56.380252 run osmo-stp_10.42.42.5(pid=25152): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25152)] 04:14:56.513636 run osmo-stp_10.42.42.5(pid=25152): stdout: | (launched: 2022-12-10_04:14:55.094284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:56.649184 run osmo-stp_10.42.42.5(pid=25152): stderr: | 20221210041455286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041455286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041455286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041455286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041455287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041455287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041455287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:56.784600 run osmo-stp_10.42.42.5(pid=25152): stdout: | (launched: 2022-12-10_04:14:55.094284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:56.914263 run osmo-stp_10.42.42.5(pid=25152): stderr: | 20221210041455286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041455286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041455286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041455286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041455287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041455287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041455287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:57.067237 run patchelf(pid=25155): Terminating (SIGINT) 04:14:57.243562 run patchelf(pid=25155): Terminated: ok {rc=0} 04:14:57.370984 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25152): Process ended prematurely: osmo-stp_10.42.42.5(pid=25152) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25152)] [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 04:14:57.381384 tst iperf3.py:8: Test FAILED (7.5 sec) 04:14:57.409625 run osmo-hlr_10.42.42.2(pid=25149): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25149)] 04:14:57.458299 run osmo-hlr_10.42.42.2(pid=25149): stdout: | (launched: 2022-12-10_04:14:54.109856) 04:14:57.509045 run osmo-hlr_10.42.42.2(pid=25149): stderr: | 20221210041454307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041454307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041454307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041454307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041454307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041454307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041454320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041454330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041454330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041454330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:57.559928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25144): Terminating (SIGTERM) 04:14:57.600867 run iperf3-srv_10.42.42.10(pid=25145): Terminating (SIGTERM) 04:14:57.641740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25148): Terminating (SIGTERM) 04:14:57.682934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25151): Terminating (SIGTERM) 04:14:57.723665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25154): Terminating (SIGTERM) 04:14:57.764589 --- ParallelTerminationStrategy: PID 25144 died... 04:14:57.784328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25144): Terminated: ok {rc=0} 04:14:57.830392 --- ParallelTerminationStrategy: PID 25145 died... 04:14:57.849817 run iperf3-srv_10.42.42.10(pid=25145): Terminated {rc=256} 04:14:57.895185 --- ParallelTerminationStrategy: PID 25148 died... 04:14:57.914450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25148): Terminated: ok {rc=0} 04:14:57.959286 --- ParallelTerminationStrategy: PID 25151 died... 04:14:57.978580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25151): Terminated: ok {rc=0} 04:14:58.024214 --- ParallelTerminationStrategy: PID 25154 died... 04:14:58.043738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25154): Terminated: ok {rc=0} 04:14:58.129556 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:14:59.273142 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.284465 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:14:59.335105 tst iperf3m4.py: using LAC 25919 04:14:59.452632 tst iperf3m4.py: using RAC 164 04:14:59.577457 tst iperf3m4.py: using CellId 25919 04:14:59.701517 tst iperf3m4.py: using BVCI 25920 04:14:59.816155 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.827589 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.838577 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.849771 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.861458 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.872446 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.883707 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.894796 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:14:59.906198 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:00.021428 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:00.135205 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:00.246940 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:00.364600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:15:00.578439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:00.933623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25156): Launched 04:15:01.233682 run iperf3-srv_10.42.42.10(pid=25157): Launched 04:15:01.387373 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:15:01.605126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:01.974429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25161): Launched 04:15:02.275393 run iperf3-srv_10.42.42.10(pid=25162): Launched 04:15:02.386823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:15:02.585719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:02.883434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25163): Launched 04:15:03.141648 run iperf3-srv_10.42.42.10(pid=25164): Launched 04:15:03.252557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:15:03.451437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:03.748491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25165): Launched 04:15:04.008311 run iperf3-srv_10.42.42.10(pid=25166): Launched 04:15:04.119856 tst iperf3m4.py:8: start network... 04:15:04.319325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:04.777701 run create_hlr_db(pid=25167): Launched 04:15:04.890762 bus /gobi_6: Setting Powered False 04:15:05.950892 run create_hlr_db(pid=25167): Terminated: ok {rc=0} 04:15:06.364710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25169): Launched 04:15:06.661551 run osmo-hlr_10.42.42.2(pid=25170): Launched 04:15:06.774309 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:07.300755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25172): Launched 04:15:07.597797 run osmo-stp_10.42.42.5(pid=25173): Launched 04:15:07.710721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:08.231603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25175): Launched 04:15:08.346061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:08.597094 run patchelf(pid=25176): Launched 04:15:08.762600 run osmo-stp_10.42.42.5(pid=25173): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25173)] 04:15:08.889291 run osmo-stp_10.42.42.5(pid=25173): stdout: | (launched: 2022-12-10_04:15:07.543566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:09.017383 run osmo-stp_10.42.42.5(pid=25173): stderr: | 20221210041507712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041507712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041507712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041507713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041507713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041507713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041507713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:09.145345 run osmo-stp_10.42.42.5(pid=25173): stdout: | (launched: 2022-12-10_04:15:07.543566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:09.267638 run osmo-stp_10.42.42.5(pid=25173): stderr: | 20221210041507712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041507712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041507712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041507713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041507713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041507713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041507713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:09.412355 run patchelf(pid=25176): Terminating (SIGINT) 04:15:09.579440 run patchelf(pid=25176): Terminated: ok {rc=0} 04:15:09.700600 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25173): Process ended prematurely: osmo-stp_10.42.42.5(pid=25173) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25173)] [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 04:15:09.710645 tst iperf3m4.py:8: Test FAILED (10.5 sec) 04:15:09.738900 run osmo-hlr_10.42.42.2(pid=25170): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25170)] 04:15:09.786733 run osmo-hlr_10.42.42.2(pid=25170): stdout: | (launched: 2022-12-10_04:15:06.606869) 04:15:09.836335 run osmo-hlr_10.42.42.2(pid=25170): stderr: | 20221210041506780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041506781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041506781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041506781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041506781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041506781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041506793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041506801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041506801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041506801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:09.886405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25156): Terminating (SIGTERM) 04:15:09.926425 run iperf3-srv_10.42.42.10(pid=25157): Terminating (SIGTERM) 04:15:09.966356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25161): Terminating (SIGTERM) 04:15:10.006238 run iperf3-srv_10.42.42.10(pid=25162): Terminating (SIGTERM) 04:15:10.046225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25163): Terminating (SIGTERM) 04:15:10.086390 run iperf3-srv_10.42.42.10(pid=25164): Terminating (SIGTERM) 04:15:10.126880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25165): Terminating (SIGTERM) 04:15:10.167063 run iperf3-srv_10.42.42.10(pid=25166): Terminating (SIGTERM) 04:15:10.206910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25169): Terminating (SIGTERM) 04:15:10.247025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25172): Terminating (SIGTERM) 04:15:10.287636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25175): Terminating (SIGTERM) 04:15:10.328239 --- ParallelTerminationStrategy: PID 25156 died... 04:15:10.347458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25156): Terminated: ok {rc=0} 04:15:10.392115 --- ParallelTerminationStrategy: PID 25157 died... 04:15:10.410650 run iperf3-srv_10.42.42.10(pid=25157): Terminated {rc=256} 04:15:10.455241 --- ParallelTerminationStrategy: PID 25161 died... 04:15:10.473726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25161): Terminated: ok {rc=0} 04:15:10.517800 --- ParallelTerminationStrategy: PID 25162 died... 04:15:10.536268 run iperf3-srv_10.42.42.10(pid=25162): Terminated {rc=256} 04:15:10.580711 --- ParallelTerminationStrategy: PID 25163 died... 04:15:10.599213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25163): Terminated: ok {rc=0} 04:15:10.643377 --- ParallelTerminationStrategy: PID 25164 died... 04:15:10.661793 run iperf3-srv_10.42.42.10(pid=25164): Terminated {rc=256} 04:15:10.706027 --- ParallelTerminationStrategy: PID 25165 died... 04:15:10.724540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25165): Terminated: ok {rc=0} 04:15:10.768433 --- ParallelTerminationStrategy: PID 25166 died... 04:15:10.787051 run iperf3-srv_10.42.42.10(pid=25166): Terminated {rc=256} 04:15:10.831041 --- ParallelTerminationStrategy: PID 25169 died... 04:15:10.849416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25169): Terminated: ok {rc=0} 04:15:10.893840 --- ParallelTerminationStrategy: PID 25172 died... 04:15:10.912347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25172): Terminated: ok {rc=0} 04:15:10.956674 --- ParallelTerminationStrategy: PID 25175 died... 04:15:10.975264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25175): Terminated: ok {rc=0} 04:15:11.060011 bus /gobi_4: Setting Powered False 04:15:12.159165 bus /gobi_4: Setting Powered False 04:15:13.273541 bus /gobi_1: Setting Powered False 04:15:14.371395 bus /gobi_1: Setting Powered False 04:15:15.487389 bus /gobi_0: Setting Powered False 04:15:16.580590 bus /gobi_0: Setting Powered False 04:15:17.711017 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 04:15:18.814220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:18.826255 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:18.877649 tst ping.py: using LAC 25920 04:15:19.000723 tst ping.py: using RAC 165 04:15:19.121228 tst ping.py: using CellId 25920 04:15:19.242513 tst ping.py: using BVCI 25921 04:15:19.355062 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:19.366387 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:19.377577 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:19.388634 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:19.400082 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:19.411287 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:19.422746 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:19.434086 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:19.547627 tst ping.py:19: start network... 04:15:19.741960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:20.191545 run create_hlr_db(pid=25179): Launched 04:15:20.302621 bus /gobi_6: Setting Powered False 04:15:21.361506 run create_hlr_db(pid=25179): Terminated: ok {rc=0} 04:15:21.786929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Launched 04:15:22.097492 run osmo-hlr_10.42.42.2(pid=25182): Launched 04:15:22.216645 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:22.759500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Launched 04:15:23.069227 run osmo-stp_10.42.42.5(pid=25185): Launched 04:15:23.187424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:23.721996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Launched 04:15:23.840583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:24.102708 run patchelf(pid=25188): Launched 04:15:24.275725 run osmo-stp_10.42.42.5(pid=25185): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] 04:15:24.408051 run osmo-stp_10.42.42.5(pid=25185): stdout: | (launched: 2022-12-10_04:15:23.012902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:24.541729 run osmo-stp_10.42.42.5(pid=25185): stderr: | 20221210041523202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041523202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041523202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041523203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041523205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041523205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041523205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:24.675419 run osmo-stp_10.42.42.5(pid=25185): stdout: | (launched: 2022-12-10_04:15:23.012902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:24.802665 run osmo-stp_10.42.42.5(pid=25185): stderr: | 20221210041523202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041523202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041523202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041523203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041523205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041523205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041523205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:24.954502 run patchelf(pid=25188): Terminating (SIGINT) 04:15:25.127793 run patchelf(pid=25188): Terminated: ok {rc=0} 04:15:25.253079 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25185): Process ended prematurely: osmo-stp_10.42.42.5(pid=25185) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 04:15:25.262649 tst ping.py:22: Test FAILED (6.4 sec) 04:15:25.290516 run osmo-hlr_10.42.42.2(pid=25182): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25182)] 04:15:25.339789 run osmo-hlr_10.42.42.2(pid=25182): stdout: | (launched: 2022-12-10_04:15:22.041048) 04:15:25.390762 run osmo-hlr_10.42.42.2(pid=25182): stderr: | 20221210041522238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041522238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041522238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041522238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041522238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041522238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041522251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041522261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041522262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041522262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:25.442176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Terminating (SIGTERM) 04:15:25.483508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Terminating (SIGTERM) 04:15:25.524929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Terminating (SIGTERM) 04:15:25.566663 --- ParallelTerminationStrategy: PID 25181 died... 04:15:25.586669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Terminated: ok {rc=0} 04:15:25.632630 --- ParallelTerminationStrategy: PID 25184 died... 04:15:25.652132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Terminated: ok {rc=0} 04:15:25.698001 --- ParallelTerminationStrategy: PID 25187 died... 04:15:25.717502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Terminated: ok {rc=0} 04:15:25.804779 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:15:26.891919 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:26.904263 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:26.960193 tst ping_idle_ping.py: using LAC 25921 04:15:27.081473 tst ping_idle_ping.py: using RAC 166 04:15:27.205496 tst ping_idle_ping.py: using CellId 25921 04:15:27.327810 tst ping_idle_ping.py: using BVCI 25922 04:15:27.440444 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:27.451822 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:27.463020 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:27.474161 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:27.485214 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:27.496305 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:27.507661 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:27.518857 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:27.631108 tst ping_idle_ping.py:24: start network... 04:15:27.828482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:28.283372 run create_hlr_db(pid=25189): Launched 04:15:28.395625 bus /gobi_6: Setting Powered False 04:15:29.455650 run create_hlr_db(pid=25189): Terminated: ok {rc=0} 04:15:29.884562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25191): Launched 04:15:30.196775 run osmo-hlr_10.42.42.2(pid=25192): Launched 04:15:30.315808 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:30.861808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25194): Launched 04:15:31.215200 run osmo-stp_10.42.42.5(pid=25195): Launched 04:15:31.448486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:32.078030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25197): Launched 04:15:32.208517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:32.471946 run patchelf(pid=25198): Launched 04:15:32.644859 run osmo-stp_10.42.42.5(pid=25195): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25195)] 04:15:32.777551 run osmo-stp_10.42.42.5(pid=25195): stdout: | (launched: 2022-12-10_04:15:31.152564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:32.911752 run osmo-stp_10.42.42.5(pid=25195): stderr: | 20221210041531453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041531454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041531454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041531454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041531455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041531455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041531455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:33.045175 run osmo-stp_10.42.42.5(pid=25195): stdout: | (launched: 2022-12-10_04:15:31.152564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:33.173115 run osmo-stp_10.42.42.5(pid=25195): stderr: | 20221210041531453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041531454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041531454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041531454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041531455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041531455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041531455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:33.324441 run patchelf(pid=25198): Terminating (SIGINT) 04:15:33.499312 run patchelf(pid=25198): Terminated: ok {rc=0} 04:15:33.625148 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25195): Process ended prematurely: osmo-stp_10.42.42.5(pid=25195) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25195)] [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 04:15:33.634891 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:15:33.662863 run osmo-hlr_10.42.42.2(pid=25192): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25192)] 04:15:33.712456 run osmo-hlr_10.42.42.2(pid=25192): stdout: | (launched: 2022-12-10_04:15:30.140164) 04:15:33.763720 run osmo-hlr_10.42.42.2(pid=25192): stderr: | 20221210041530335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041530335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041530335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041530336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041530336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041530336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041530346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041530355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041530355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041530355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:33.815351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25191): Terminating (SIGTERM) 04:15:33.857082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25194): Terminating (SIGTERM) 04:15:33.898683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25197): Terminating (SIGTERM) 04:15:33.940363 --- ParallelTerminationStrategy: PID 25191 died... 04:15:33.960296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25191): Terminated: ok {rc=0} 04:15:34.006282 --- ParallelTerminationStrategy: PID 25194 died... 04:15:34.025786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25194): Terminated: ok {rc=0} 04:15:34.071500 --- ParallelTerminationStrategy: PID 25197 died... 04:15:34.091066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25197): Terminated: ok {rc=0} 04:15:34.178253 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:15:35.473787 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:15:35.479685 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:15:35.515309 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:15:35.554837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:15:35.648384 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:15:35.681523 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:15:35.720744 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:15:36.307223 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:15:36.357442 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.368292 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:15:36.435559 tst cs_paging_gprs_active.py: using LAC 25922 04:15:36.553645 tst cs_paging_gprs_active.py: using RAC 167 04:15:36.677528 tst cs_paging_gprs_active.py: using CellId 25922 04:15:36.794649 tst cs_paging_gprs_active.py: using BVCI 25923 04:15:36.902776 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.913849 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.924663 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.936181 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.947650 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.959152 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.970803 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.982239 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:36.993869 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:15:37.113540 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:15:37.233600 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:15:37.448550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:37.766899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25203): Launched 04:15:38.043034 run iperf3-srv_10.42.42.10(pid=25204): Launched 04:15:38.162333 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:15:38.376447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:38.694358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25205): Launched 04:15:38.969775 run iperf3-srv_10.42.42.10(pid=25206): Launched 04:15:39.088126 tst cs_paging_gprs_active.py:38: start network... 04:15:39.301681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:39.792070 run create_hlr_db(pid=25207): Launched 04:15:39.920266 bus /gobi_6: Setting Powered False 04:15:40.983332 run create_hlr_db(pid=25207): Terminated: ok {rc=0} 04:15:41.407490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25209): Launched 04:15:41.703241 run osmo-hlr_10.42.42.2(pid=25210): Launched 04:15:41.816084 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:42.329331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25212): Launched 04:15:42.624598 run osmo-stp_10.42.42.5(pid=25213): Launched 04:15:42.738168 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:43.249229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25215): Launched 04:15:43.362432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:43.619423 run patchelf(pid=25216): Launched 04:15:43.785230 run osmo-stp_10.42.42.5(pid=25213): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25213)] 04:15:43.911328 run osmo-stp_10.42.42.5(pid=25213): stdout: | (launched: 2022-12-10_04:15:42.570494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:44.038946 run osmo-stp_10.42.42.5(pid=25213): stderr: | 20221210041542739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041542739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041542739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041542739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041542742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041542742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041542742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:44.167122 run osmo-stp_10.42.42.5(pid=25213): stdout: | (launched: 2022-12-10_04:15:42.570494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:44.288936 run osmo-stp_10.42.42.5(pid=25213): stderr: | 20221210041542739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041542739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041542739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041542739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041542742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041542742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041542742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:44.433807 run patchelf(pid=25216): Terminating (SIGINT) 04:15:44.601647 run patchelf(pid=25216): Terminated: ok {rc=0} 04:15:44.722851 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25213): Process ended prematurely: osmo-stp_10.42.42.5(pid=25213) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25213)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:15:44.732424 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 04:15:44.760118 run osmo-hlr_10.42.42.2(pid=25210): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25210)] 04:15:44.807222 run osmo-hlr_10.42.42.2(pid=25210): stdout: | (launched: 2022-12-10_04:15:41.649190) 04:15:44.856262 run osmo-hlr_10.42.42.2(pid=25210): stderr: | 20221210041541825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041541825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041541825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041541825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041541825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041541825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041541837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041541846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041541846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041541846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:44.905666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25203): Terminating (SIGTERM) 04:15:44.945271 run iperf3-srv_10.42.42.10(pid=25204): Terminating (SIGTERM) 04:15:44.985166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25205): Terminating (SIGTERM) 04:15:45.024526 run iperf3-srv_10.42.42.10(pid=25206): Terminating (SIGTERM) 04:15:45.064149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25209): Terminating (SIGTERM) 04:15:45.103762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25212): Terminating (SIGTERM) 04:15:45.143057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25215): Terminating (SIGTERM) 04:15:45.182744 --- ParallelTerminationStrategy: PID 25203 died... 04:15:45.201595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25203): Terminated: ok {rc=0} 04:15:45.245473 --- ParallelTerminationStrategy: PID 25204 died... 04:15:45.264228 run iperf3-srv_10.42.42.10(pid=25204): Terminated {rc=256} 04:15:45.308232 --- ParallelTerminationStrategy: PID 25205 died... 04:15:45.326863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25205): Terminated: ok {rc=0} 04:15:45.371273 --- ParallelTerminationStrategy: PID 25206 died... 04:15:45.389764 run iperf3-srv_10.42.42.10(pid=25206): Terminated {rc=256} 04:15:45.433460 --- ParallelTerminationStrategy: PID 25209 died... 04:15:45.451959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25209): Terminated: ok {rc=0} 04:15:45.496386 --- ParallelTerminationStrategy: PID 25212 died... 04:15:45.514926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25212): Terminated: ok {rc=0} 04:15:45.558827 --- ParallelTerminationStrategy: PID 25215 died... 04:15:45.577376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25215): Terminated: ok {rc=0} 04:15:45.662705 bus /gobi_0: Setting Powered False 04:15:46.760261 bus /gobi_0: Setting Powered False 04:15:47.875897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:15:49.019952 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.031471 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:15:49.100123 tst iperf3.py: using LAC 25923 04:15:49.217509 tst iperf3.py: using RAC 168 04:15:49.342448 tst iperf3.py: using CellId 25923 04:15:49.467650 tst iperf3.py: using BVCI 25924 04:15:49.576928 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.587950 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.598913 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.610433 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.621675 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.633235 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.644735 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.656162 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:49.667805 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:15:49.782561 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:15:49.982589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:50.280636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25217): Launched 04:15:50.538050 run iperf3-srv_10.42.42.10(pid=25218): Launched 04:15:50.648702 tst iperf3.py:8: start network... 04:15:50.847661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:51.305112 run create_hlr_db(pid=25219): Launched 04:15:51.417461 bus /gobi_6: Setting Powered False 04:15:52.477244 run create_hlr_db(pid=25219): Terminated: ok {rc=0} 04:15:52.888433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25221): Launched 04:15:53.183355 run osmo-hlr_10.42.42.2(pid=25222): Launched 04:15:53.295223 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:53.902318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25224): Launched 04:15:54.210441 run osmo-stp_10.42.42.5(pid=25225): Launched 04:15:54.327425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:54.857976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25227): Launched 04:15:54.975604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:55.234905 run patchelf(pid=25228): Launched 04:15:55.405184 run osmo-stp_10.42.42.5(pid=25225): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25225)] 04:15:55.536012 run osmo-stp_10.42.42.5(pid=25225): stdout: | (launched: 2022-12-10_04:15:54.155017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:55.668461 run osmo-stp_10.42.42.5(pid=25225): stderr: | 20221210041554343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041554343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041554343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041554344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041554346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041554346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041554346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:55.800664 run osmo-stp_10.42.42.5(pid=25225): stdout: | (launched: 2022-12-10_04:15:54.155017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:55.927516 run osmo-stp_10.42.42.5(pid=25225): stderr: | 20221210041554343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041554343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041554343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041554344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041554346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041554346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041554346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:56.077276 run patchelf(pid=25228): Terminating (SIGINT) 04:15:56.249513 run patchelf(pid=25228): Terminated: ok {rc=0} 04:15:56.373988 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25225): Process ended prematurely: osmo-stp_10.42.42.5(pid=25225) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25225)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 04:15:56.384154 tst iperf3.py:8: Test FAILED (7.4 sec) 04:15:56.412411 run osmo-hlr_10.42.42.2(pid=25222): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25222)] 04:15:56.461275 run osmo-hlr_10.42.42.2(pid=25222): stdout: | (launched: 2022-12-10_04:15:53.129461) 04:15:56.511548 run osmo-hlr_10.42.42.2(pid=25222): stderr: | 20221210041553303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041553303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041553303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041553303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041553303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041553303 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041553315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041553323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041553324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041553324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:56.562360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25217): Terminating (SIGTERM) 04:15:56.603117 run iperf3-srv_10.42.42.10(pid=25218): Terminating (SIGTERM) 04:15:56.643759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25221): Terminating (SIGTERM) 04:15:56.685088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25224): Terminating (SIGTERM) 04:15:56.725945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25227): Terminating (SIGTERM) 04:15:56.766861 --- ParallelTerminationStrategy: PID 25217 died... 04:15:56.786498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25217): Terminated: ok {rc=0} 04:15:56.832262 --- ParallelTerminationStrategy: PID 25218 died... 04:15:56.851740 run iperf3-srv_10.42.42.10(pid=25218): Terminated {rc=256} 04:15:56.897324 --- ParallelTerminationStrategy: PID 25221 died... 04:15:56.916671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25221): Terminated: ok {rc=0} 04:15:56.962012 --- ParallelTerminationStrategy: PID 25224 died... 04:15:56.981264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25224): Terminated: ok {rc=0} 04:15:57.026629 --- ParallelTerminationStrategy: PID 25227 died... 04:15:57.045818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25227): Terminated: ok {rc=0} 04:15:57.131992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:15:58.274443 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.285953 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:15:58.357279 tst iperf3m4.py: using LAC 25924 04:15:58.486521 tst iperf3m4.py: using RAC 169 04:15:58.618925 tst iperf3m4.py: using CellId 25924 04:15:58.741861 tst iperf3m4.py: using BVCI 25925 04:15:58.855363 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.866686 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.877867 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.889119 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.900150 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.911250 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.922480 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.933486 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:15:58.944640 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:15:59.060521 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:15:59.175546 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:15:59.292109 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:15:59.405123 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:15:59.599721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:59.890656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25229): Launched 04:16:00.141693 run iperf3-srv_10.42.42.10(pid=25230): Launched 04:16:00.249711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:16:00.443309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:00.734110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25231): Launched 04:16:01.052011 run iperf3-srv_10.42.42.10(pid=25232): Launched 04:16:01.215592 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:16:01.428470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:01.830329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25233): Launched 04:16:02.169351 run iperf3-srv_10.42.42.10(pid=25234): Launched 04:16:02.283448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:16:02.489059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:02.780826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25235): Launched 04:16:03.033027 run iperf3-srv_10.42.42.10(pid=25236): Launched 04:16:03.141084 tst iperf3m4.py:8: start network... 04:16:03.335067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:03.785458 run create_hlr_db(pid=25237): Launched 04:16:03.897153 bus /gobi_6: Setting Powered False 04:16:04.956004 run create_hlr_db(pid=25237): Terminated: ok {rc=0} 04:16:05.380086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25239): Launched 04:16:05.690465 run osmo-hlr_10.42.42.2(pid=25240): Launched 04:16:05.807965 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:06.340104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25242): Launched 04:16:06.647437 run osmo-stp_10.42.42.5(pid=25243): Launched 04:16:06.764886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:07.298157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25245): Launched 04:16:07.416566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:07.677698 run patchelf(pid=25246): Launched 04:16:07.849800 run osmo-stp_10.42.42.5(pid=25243): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25243)] 04:16:07.981876 run osmo-stp_10.42.42.5(pid=25243): stdout: | (launched: 2022-12-10_04:16:06.591705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:08.114961 run osmo-stp_10.42.42.5(pid=25243): stderr: | 20221210041606781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041606781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041606782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041606782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041606782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041606783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041606783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:08.248393 run osmo-stp_10.42.42.5(pid=25243): stdout: | (launched: 2022-12-10_04:16:06.591705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:08.375703 run osmo-stp_10.42.42.5(pid=25243): stderr: | 20221210041606781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041606781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041606782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041606782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041606782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041606783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041606783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:08.526116 run patchelf(pid=25246): Terminating (SIGINT) 04:16:08.699708 run patchelf(pid=25246): Terminated: ok {rc=0} 04:16:08.826037 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25243): Process ended prematurely: osmo-stp_10.42.42.5(pid=25243) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25243)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:16:08.836439 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:16:08.865446 run osmo-hlr_10.42.42.2(pid=25240): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25240)] 04:16:08.914707 run osmo-hlr_10.42.42.2(pid=25240): stdout: | (launched: 2022-12-10_04:16:05.634172) 04:16:08.965565 run osmo-hlr_10.42.42.2(pid=25240): stderr: | 20221210041605827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041605828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041605828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041605828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041605828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041605828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041605841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041605849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041605849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041605850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:09.016927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25229): Terminating (SIGTERM) 04:16:09.058399 run iperf3-srv_10.42.42.10(pid=25230): Terminating (SIGTERM) 04:16:09.099935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25231): Terminating (SIGTERM) 04:16:09.141135 run iperf3-srv_10.42.42.10(pid=25232): Terminating (SIGTERM) 04:16:09.182032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25233): Terminating (SIGTERM) 04:16:09.223026 run iperf3-srv_10.42.42.10(pid=25234): Terminating (SIGTERM) 04:16:09.264316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25235): Terminating (SIGTERM) 04:16:09.305467 run iperf3-srv_10.42.42.10(pid=25236): Terminating (SIGTERM) 04:16:09.346538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25239): Terminating (SIGTERM) 04:16:09.387619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25242): Terminating (SIGTERM) 04:16:09.428583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25245): Terminating (SIGTERM) 04:16:09.469832 --- ParallelTerminationStrategy: PID 25229 died... 04:16:09.489739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25229): Terminated: ok {rc=0} 04:16:09.534947 --- ParallelTerminationStrategy: PID 25230 died... 04:16:09.553919 run iperf3-srv_10.42.42.10(pid=25230): Terminated {rc=256} 04:16:09.598808 --- ParallelTerminationStrategy: PID 25231 died... 04:16:09.617837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25231): Terminated: ok {rc=0} 04:16:09.662932 --- ParallelTerminationStrategy: PID 25232 died... 04:16:09.681898 run iperf3-srv_10.42.42.10(pid=25232): Terminated {rc=256} 04:16:09.726851 --- ParallelTerminationStrategy: PID 25233 died... 04:16:09.746075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25233): Terminated: ok {rc=0} 04:16:09.791258 --- ParallelTerminationStrategy: PID 25234 died... 04:16:09.810340 run iperf3-srv_10.42.42.10(pid=25234): Terminated {rc=256} 04:16:09.855671 --- ParallelTerminationStrategy: PID 25235 died... 04:16:09.874848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25235): Terminated: ok {rc=0} 04:16:09.919945 --- ParallelTerminationStrategy: PID 25236 died... 04:16:09.939028 run iperf3-srv_10.42.42.10(pid=25236): Terminated {rc=256} 04:16:09.984534 --- ParallelTerminationStrategy: PID 25239 died... 04:16:10.003885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25239): Terminated: ok {rc=0} 04:16:10.048833 --- ParallelTerminationStrategy: PID 25242 died... 04:16:10.068006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25242): Terminated: ok {rc=0} 04:16:10.113070 --- ParallelTerminationStrategy: PID 25245 died... 04:16:10.132125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25245): Terminated: ok {rc=0} 04:16:10.217729 bus /gobi_4: Setting Powered False 04:16:11.313678 bus /gobi_4: Setting Powered False 04:16:12.427924 bus /gobi_1: Setting Powered False 04:16:13.524698 bus /gobi_1: Setting Powered False 04:16:14.639144 bus /gobi_0: Setting Powered False 04:16:15.735464 bus /gobi_0: Setting Powered False 04:16:16.847635 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:16:17.947098 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:17.958435 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:18.027442 tst ping.py: using LAC 25925 04:16:18.139957 tst ping.py: using RAC 170 04:16:18.251646 tst ping.py: using CellId 25925 04:16:18.363138 tst ping.py: using BVCI 25926 04:16:18.466224 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:18.477142 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:18.487716 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:18.498641 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:18.509210 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:18.519988 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:18.530663 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:18.541494 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:18.656161 tst ping.py:19: start network... 04:16:18.863205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:19.336917 run create_hlr_db(pid=25249): Launched 04:16:19.460925 bus /gobi_6: Setting Powered False 04:16:20.522032 run create_hlr_db(pid=25249): Terminated: ok {rc=0} 04:16:20.932006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25251): Launched 04:16:21.216816 run osmo-hlr_10.42.42.2(pid=25252): Launched 04:16:21.325009 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:21.830178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25254): Launched 04:16:22.114902 run osmo-stp_10.42.42.5(pid=25255): Launched 04:16:22.223278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:22.717306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25257): Launched 04:16:22.826560 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:23.068649 run patchelf(pid=25258): Launched 04:16:23.227180 run osmo-stp_10.42.42.5(pid=25255): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25255)] 04:16:23.348818 run osmo-stp_10.42.42.5(pid=25255): stdout: | (launched: 2022-12-10_04:16:22.063000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:23.471853 run osmo-stp_10.42.42.5(pid=25255): stderr: | 20221210041622228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041622228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041622228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041622228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041622231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041622231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041622231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:23.595181 run osmo-stp_10.42.42.5(pid=25255): stdout: | (launched: 2022-12-10_04:16:22.063000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:23.712919 run osmo-stp_10.42.42.5(pid=25255): stderr: | 20221210041622228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041622228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041622228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041622228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041622231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041622231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041622231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:23.852221 run patchelf(pid=25258): Terminating (SIGINT) 04:16:24.012767 run patchelf(pid=25258): Terminated: ok {rc=0} 04:16:24.129252 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25255): Process ended prematurely: osmo-stp_10.42.42.5(pid=25255) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25255)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 04:16:24.138235 tst ping.py:22: Test FAILED (6.2 sec) 04:16:24.164772 run osmo-hlr_10.42.42.2(pid=25252): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25252)] 04:16:24.212200 run osmo-hlr_10.42.42.2(pid=25252): stdout: | (launched: 2022-12-10_04:16:21.164877) 04:16:24.260772 run osmo-hlr_10.42.42.2(pid=25252): stderr: | 20221210041621338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041621338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041621338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041621338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041621338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041621338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041621351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041621359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041621359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041621359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:24.310019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25251): Terminating (SIGTERM) 04:16:24.349258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25254): Terminating (SIGTERM) 04:16:24.388904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25257): Terminating (SIGTERM) 04:16:24.428491 --- ParallelTerminationStrategy: PID 25251 died... 04:16:24.447307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25251): Terminated: ok {rc=0} 04:16:24.490643 --- ParallelTerminationStrategy: PID 25254 died... 04:16:24.508748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25254): Terminated: ok {rc=0} 04:16:24.551729 --- ParallelTerminationStrategy: PID 25257 died... 04:16:24.569930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25257): Terminated: ok {rc=0} 04:16:24.652055 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:16:25.738207 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:25.750805 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:25.822665 tst ping_idle_ping.py: using LAC 25926 04:16:25.936232 tst ping_idle_ping.py: using RAC 171 04:16:26.049180 tst ping_idle_ping.py: using CellId 25926 04:16:26.170985 tst ping_idle_ping.py: using BVCI 25927 04:16:26.283210 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:26.294784 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:26.306059 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:26.318002 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:26.329920 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:26.341742 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:26.353747 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:26.365665 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:26.479406 tst ping_idle_ping.py:24: start network... 04:16:26.671984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:27.115101 run create_hlr_db(pid=25259): Launched 04:16:27.223791 bus /gobi_6: Setting Powered False 04:16:28.281032 run create_hlr_db(pid=25259): Terminated: ok {rc=0} 04:16:28.699648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25261): Launched 04:16:29.005259 run osmo-hlr_10.42.42.2(pid=25262): Launched 04:16:29.122212 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:29.648116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25265): Launched 04:16:29.954690 run osmo-stp_10.42.42.5(pid=25266): Launched 04:16:30.070806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:30.598598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25268): Launched 04:16:30.714823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:30.991739 run patchelf(pid=25269): Launched 04:16:31.165833 run osmo-stp_10.42.42.5(pid=25266): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25266)] 04:16:31.295582 run osmo-stp_10.42.42.5(pid=25266): stdout: | (launched: 2022-12-10_04:16:29.899323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:31.424861 run osmo-stp_10.42.42.5(pid=25266): stderr: | 20221210041630087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041630087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041630088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041630088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041630091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041630091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041630091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:31.555606 run osmo-stp_10.42.42.5(pid=25266): stdout: | (launched: 2022-12-10_04:16:29.899323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:31.681142 run osmo-stp_10.42.42.5(pid=25266): stderr: | 20221210041630087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041630087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041630088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041630088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041630091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041630091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041630091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:31.826302 run patchelf(pid=25269): Terminating (SIGINT) 04:16:31.995860 run patchelf(pid=25269): Terminated: ok {rc=0} 04:16:32.119585 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25266): Process ended prematurely: osmo-stp_10.42.42.5(pid=25266) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25266)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:16:32.129705 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:16:32.159484 run osmo-hlr_10.42.42.2(pid=25262): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25262)] 04:16:32.208132 run osmo-hlr_10.42.42.2(pid=25262): stdout: | (launched: 2022-12-10_04:16:28.950333) 04:16:32.257859 run osmo-hlr_10.42.42.2(pid=25262): stderr: | 20221210041629147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041629147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041629147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041629147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041629147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041629147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041629160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041629168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041629168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041629168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:32.308314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25261): Terminating (SIGTERM) 04:16:32.348496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25265): Terminating (SIGTERM) 04:16:32.388310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25268): Terminating (SIGTERM) 04:16:32.428618 --- ParallelTerminationStrategy: PID 25261 died... 04:16:32.447564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25261): Terminated: ok {rc=0} 04:16:32.492732 --- ParallelTerminationStrategy: PID 25265 died... 04:16:32.511172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25265): Terminated: ok {rc=0} 04:16:32.555927 --- ParallelTerminationStrategy: PID 25268 died... 04:16:32.574413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25268): Terminated: ok {rc=0} 04:16:32.660186 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:16:33.957743 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:16:33.963989 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:16:33.997389 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:16:34.035747 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:16:34.123583 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:16:34.155920 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:16:34.194324 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:16:34.793539 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:16:34.842489 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:34.853566 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:16:34.921397 tst cs_paging_gprs_active.py: using LAC 25927 04:16:35.034825 tst cs_paging_gprs_active.py: using RAC 172 04:16:35.148341 tst cs_paging_gprs_active.py: using CellId 25927 04:16:35.261366 tst cs_paging_gprs_active.py: using BVCI 25928 04:16:35.366997 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.377878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.388467 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.399628 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.410709 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.421997 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.433210 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.444142 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:35.455546 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:16:35.573110 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:16:35.690271 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:16:35.887690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:36.181908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25273): Launched 04:16:36.436525 run iperf3-srv_10.42.42.10(pid=25274): Launched 04:16:36.546621 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:16:36.743304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:37.037867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25275): Launched 04:16:37.292290 run iperf3-srv_10.42.42.10(pid=25276): Launched 04:16:37.402132 tst cs_paging_gprs_active.py:38: start network... 04:16:37.598294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:38.050212 run create_hlr_db(pid=25277): Launched 04:16:38.160618 bus /gobi_6: Setting Powered False 04:16:39.219649 run create_hlr_db(pid=25277): Terminated: ok {rc=0} 04:16:39.646809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25279): Launched 04:16:39.957156 run osmo-hlr_10.42.42.2(pid=25280): Launched 04:16:40.075114 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:40.608837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25282): Launched 04:16:40.919234 run osmo-stp_10.42.42.5(pid=25283): Launched 04:16:41.039925 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:41.575169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25285): Launched 04:16:41.693780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:41.957802 run patchelf(pid=25286): Launched 04:16:42.130231 run osmo-stp_10.42.42.5(pid=25283): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25283)] 04:16:42.261868 run osmo-stp_10.42.42.5(pid=25283): stdout: | (launched: 2022-12-10_04:16:40.863012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:42.395248 run osmo-stp_10.42.42.5(pid=25283): stderr: | 20221210041641054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041641054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041641054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041641054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041641055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041641055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041641055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:42.528383 run osmo-stp_10.42.42.5(pid=25283): stdout: | (launched: 2022-12-10_04:16:40.863012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:42.655716 run osmo-stp_10.42.42.5(pid=25283): stderr: | 20221210041641054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041641054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041641054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041641054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041641055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041641055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041641055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:42.806155 run patchelf(pid=25286): Terminating (SIGINT) 04:16:42.981355 run patchelf(pid=25286): Terminated: ok {rc=0} 04:16:43.107614 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25283): Process ended prematurely: osmo-stp_10.42.42.5(pid=25283) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25283)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:16:43.117992 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 04:16:43.146181 run osmo-hlr_10.42.42.2(pid=25280): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25280)] 04:16:43.194781 run osmo-hlr_10.42.42.2(pid=25280): stdout: | (launched: 2022-12-10_04:16:39.900610) 04:16:43.245328 run osmo-hlr_10.42.42.2(pid=25280): stderr: | 20221210041640094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041640094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041640095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041640095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041640095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041640095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041640110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041640119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041640119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041640119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:43.296187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25273): Terminating (SIGTERM) 04:16:43.337195 run iperf3-srv_10.42.42.10(pid=25274): Terminating (SIGTERM) 04:16:43.378054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25275): Terminating (SIGTERM) 04:16:43.418963 run iperf3-srv_10.42.42.10(pid=25276): Terminating (SIGTERM) 04:16:43.459755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25279): Terminating (SIGTERM) 04:16:43.500777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25282): Terminating (SIGTERM) 04:16:43.541644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25285): Terminating (SIGTERM) 04:16:43.582828 --- ParallelTerminationStrategy: PID 25273 died... 04:16:43.602469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25273): Terminated: ok {rc=0} 04:16:43.647918 --- ParallelTerminationStrategy: PID 25274 died... 04:16:43.667142 run iperf3-srv_10.42.42.10(pid=25274): Terminated {rc=256} 04:16:43.712531 --- ParallelTerminationStrategy: PID 25275 died... 04:16:43.731704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25275): Terminated: ok {rc=0} 04:16:43.777198 --- ParallelTerminationStrategy: PID 25276 died... 04:16:43.796416 run iperf3-srv_10.42.42.10(pid=25276): Terminated {rc=256} 04:16:43.842195 --- ParallelTerminationStrategy: PID 25279 died... 04:16:43.861828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25279): Terminated: ok {rc=0} 04:16:43.907506 --- ParallelTerminationStrategy: PID 25282 died... 04:16:43.927017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25282): Terminated: ok {rc=0} 04:16:43.972349 --- ParallelTerminationStrategy: PID 25285 died... 04:16:43.991796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25285): Terminated: ok {rc=0} 04:16:44.078137 bus /gobi_0: Setting Powered False 04:16:45.176213 bus /gobi_0: Setting Powered False 04:16:46.293116 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:16:47.435795 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:47.447047 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:16:47.515660 tst iperf3.py: using LAC 25928 04:16:47.629586 tst iperf3.py: using RAC 173 04:16:47.747936 tst iperf3.py: using CellId 25928 04:16:47.863553 tst iperf3.py: using BVCI 25929 04:16:47.968706 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:47.979609 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:47.990204 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:48.001131 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:48.011843 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:48.022725 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:48.034164 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:48.044789 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:48.055693 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:16:48.169774 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:16:48.365140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:48.657329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25287): Launched 04:16:48.911589 run iperf3-srv_10.42.42.10(pid=25288): Launched 04:16:49.020344 tst iperf3.py:8: start network... 04:16:49.216214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:49.666489 run create_hlr_db(pid=25289): Launched 04:16:49.777773 bus /gobi_6: Setting Powered False 04:16:50.836392 run create_hlr_db(pid=25289): Terminated: ok {rc=0} 04:16:51.242278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25291): Launched 04:16:51.532811 run osmo-hlr_10.42.42.2(pid=25292): Launched 04:16:51.643733 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:52.144584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25294): Launched 04:16:52.434821 run osmo-stp_10.42.42.5(pid=25295): Launched 04:16:52.546609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:53.049710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25297): Launched 04:16:53.162135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:53.407628 run patchelf(pid=25298): Launched 04:16:53.569197 run osmo-stp_10.42.42.5(pid=25295): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25295)] 04:16:53.692760 run osmo-stp_10.42.42.5(pid=25295): stdout: | (launched: 2022-12-10_04:16:52.382119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:53.818279 run osmo-stp_10.42.42.5(pid=25295): stderr: | 20221210041652549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041652549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041652550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041652550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041652550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041652551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041652551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:53.943882 run osmo-stp_10.42.42.5(pid=25295): stdout: | (launched: 2022-12-10_04:16:52.382119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:54.063477 run osmo-stp_10.42.42.5(pid=25295): stderr: | 20221210041652549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041652549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041652550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041652550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041652550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041652551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041652551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:54.205730 run patchelf(pid=25298): Terminating (SIGINT) 04:16:54.370501 run patchelf(pid=25298): Terminated: ok {rc=0} 04:16:54.489689 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25295): Process ended prematurely: osmo-stp_10.42.42.5(pid=25295) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25295)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 04:16:54.499280 tst iperf3.py:8: Test FAILED (7.1 sec) 04:16:54.526248 run osmo-hlr_10.42.42.2(pid=25292): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25292)] 04:16:54.573160 run osmo-hlr_10.42.42.2(pid=25292): stdout: | (launched: 2022-12-10_04:16:51.479752) 04:16:54.621703 run osmo-hlr_10.42.42.2(pid=25292): stderr: | 20221210041651654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041651654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041651654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041651654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041651654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041651654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041651666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041651674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041651674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041651674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:54.670427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25287): Terminating (SIGTERM) 04:16:54.709516 run iperf3-srv_10.42.42.10(pid=25288): Terminating (SIGTERM) 04:16:54.748773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25291): Terminating (SIGTERM) 04:16:54.788115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25294): Terminating (SIGTERM) 04:16:54.827569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25297): Terminating (SIGTERM) 04:16:54.867077 --- ParallelTerminationStrategy: PID 25287 died... 04:16:54.885857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25287): Terminated: ok {rc=0} 04:16:54.929456 --- ParallelTerminationStrategy: PID 25288 died... 04:16:54.947538 run iperf3-srv_10.42.42.10(pid=25288): Terminated {rc=256} 04:16:54.991133 --- ParallelTerminationStrategy: PID 25291 died... 04:16:55.009486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25291): Terminated: ok {rc=0} 04:16:55.053140 --- ParallelTerminationStrategy: PID 25294 died... 04:16:55.071339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25294): Terminated: ok {rc=0} 04:16:55.115264 --- ParallelTerminationStrategy: PID 25297 died... 04:16:55.133643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25297): Terminated: ok {rc=0} 04:16:55.216986 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:16:56.362595 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:56.375863 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:16:56.449144 tst iperf3m4.py: using LAC 25929 04:16:56.572731 tst iperf3m4.py: using RAC 174 04:16:56.695725 tst iperf3m4.py: using CellId 25929 04:16:56.819121 tst iperf3m4.py: using BVCI 25930 04:16:56.932473 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:56.944150 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:56.955610 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:56.967372 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:56.979012 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:56.990837 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:57.002679 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:57.014307 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:16:57.026140 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:16:57.144346 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:16:57.262391 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:16:57.375960 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:16:57.493520 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:16:57.704023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:58.016554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25299): Launched 04:16:58.286638 run iperf3-srv_10.42.42.10(pid=25300): Launched 04:16:58.402833 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:16:58.613369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:58.925656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25301): Launched 04:16:59.196138 run iperf3-srv_10.42.42.10(pid=25302): Launched 04:16:59.312564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:16:59.522417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:59.834354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25303): Launched 04:17:00.104819 run iperf3-srv_10.42.42.10(pid=25304): Launched 04:17:00.221473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:17:00.431493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:00.743327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25305): Launched 04:17:01.049753 run iperf3-srv_10.42.42.10(pid=25306): Launched 04:17:01.168252 tst iperf3m4.py:8: start network... 04:17:01.392004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:01.926102 run create_hlr_db(pid=25310): Launched 04:17:02.085478 bus /gobi_6: Setting Powered False 04:17:03.147406 run create_hlr_db(pid=25310): Terminated: ok {rc=0} 04:17:03.581521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Launched 04:17:03.892327 run osmo-hlr_10.42.42.2(pid=25313): Launched 04:17:04.010610 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:04.553411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Launched 04:17:04.863929 run osmo-stp_10.42.42.5(pid=25316): Launched 04:17:04.982392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:05.519960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25318): Launched 04:17:05.639107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:05.901875 run patchelf(pid=25319): Launched 04:17:06.074855 run osmo-stp_10.42.42.5(pid=25316): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] 04:17:06.207545 run osmo-stp_10.42.42.5(pid=25316): stdout: | (launched: 2022-12-10_04:17:04.807476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:06.341956 run osmo-stp_10.42.42.5(pid=25316): stderr: | 20221210041704995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041704995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041704995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041704996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041704996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041704996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041704997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:06.476387 run osmo-stp_10.42.42.5(pid=25316): stdout: | (launched: 2022-12-10_04:17:04.807476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:06.604586 run osmo-stp_10.42.42.5(pid=25316): stderr: | 20221210041704995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041704995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041704995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041704996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041704996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041704996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041704997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:06.755944 run patchelf(pid=25319): Terminating (SIGINT) 04:17:06.931813 run patchelf(pid=25319): Terminated: ok {rc=0} 04:17:07.058657 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25316): Process ended prematurely: osmo-stp_10.42.42.5(pid=25316) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:17:07.069325 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:17:07.098544 run osmo-hlr_10.42.42.2(pid=25313): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25313)] 04:17:07.148377 run osmo-hlr_10.42.42.2(pid=25313): stdout: | (launched: 2022-12-10_04:17:03.835511) 04:17:07.199900 run osmo-hlr_10.42.42.2(pid=25313): stderr: | 20221210041704032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041704032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041704032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041704032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041704032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041704033 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041704045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041704053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041704054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041704054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:07.251937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25299): Terminating (SIGTERM) 04:17:07.293916 run iperf3-srv_10.42.42.10(pid=25300): Terminating (SIGTERM) 04:17:07.335892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25301): Terminating (SIGTERM) 04:17:07.377771 run iperf3-srv_10.42.42.10(pid=25302): Terminating (SIGTERM) 04:17:07.419452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25303): Terminating (SIGTERM) 04:17:07.461393 run iperf3-srv_10.42.42.10(pid=25304): Terminating (SIGTERM) 04:17:07.502897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25305): Terminating (SIGTERM) 04:17:07.544500 run iperf3-srv_10.42.42.10(pid=25306): Terminating (SIGTERM) 04:17:07.585997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Terminating (SIGTERM) 04:17:07.627464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Terminating (SIGTERM) 04:17:07.669117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25318): Terminating (SIGTERM) 04:17:07.710828 --- ParallelTerminationStrategy: PID 25299 died... 04:17:07.730663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25299): Terminated: ok {rc=0} 04:17:07.776548 --- ParallelTerminationStrategy: PID 25300 died... 04:17:07.795860 run iperf3-srv_10.42.42.10(pid=25300): Terminated {rc=256} 04:17:07.841483 --- ParallelTerminationStrategy: PID 25301 died... 04:17:07.860819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25301): Terminated: ok {rc=0} 04:17:07.906692 --- ParallelTerminationStrategy: PID 25302 died... 04:17:07.926077 run iperf3-srv_10.42.42.10(pid=25302): Terminated {rc=256} 04:17:07.971562 --- ParallelTerminationStrategy: PID 25303 died... 04:17:07.990885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25303): Terminated: ok {rc=0} 04:17:08.036382 --- ParallelTerminationStrategy: PID 25304 died... 04:17:08.055608 run iperf3-srv_10.42.42.10(pid=25304): Terminated {rc=256} 04:17:08.101316 --- ParallelTerminationStrategy: PID 25305 died... 04:17:08.120603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25305): Terminated: ok {rc=0} 04:17:08.166637 --- ParallelTerminationStrategy: PID 25306 died... 04:17:08.186092 run iperf3-srv_10.42.42.10(pid=25306): Terminated {rc=256} 04:17:08.231644 --- ParallelTerminationStrategy: PID 25312 died... 04:17:08.250834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Terminated: ok {rc=0} 04:17:08.296136 --- ParallelTerminationStrategy: PID 25315 died... 04:17:08.315404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Terminated: ok {rc=0} 04:17:08.360942 --- ParallelTerminationStrategy: PID 25318 died... 04:17:08.380490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25318): Terminated: ok {rc=0} 04:17:08.468059 bus /gobi_4: Setting Powered False 04:17:09.566370 bus /gobi_4: Setting Powered False 04:17:10.683897 bus /gobi_1: Setting Powered False 04:17:11.782015 bus /gobi_1: Setting Powered False 04:17:12.896721 bus /gobi_0: Setting Powered False 04:17:13.994154 bus /gobi_0: Setting Powered False 04:17:15.107817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:17:16.207389 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.219224 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:16.291776 tst ping.py: using LAC 25930 04:17:16.407482 tst ping.py: using RAC 175 04:17:16.526093 tst ping.py: using CellId 25930 04:17:16.641312 tst ping.py: using BVCI 25931 04:17:16.789951 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.805886 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.821773 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.835563 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.848458 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.859749 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.871139 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:16.882633 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:16.996639 tst ping.py:19: start network... 04:17:17.192940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:17.642466 run create_hlr_db(pid=25320): Launched 04:17:17.752736 bus /gobi_6: Setting Powered False 04:17:18.811319 run create_hlr_db(pid=25320): Terminated: ok {rc=0} 04:17:19.212710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25322): Launched 04:17:19.499953 run osmo-hlr_10.42.42.2(pid=25323): Launched 04:17:19.609076 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:20.117119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25325): Launched 04:17:20.402624 run osmo-stp_10.42.42.5(pid=25326): Launched 04:17:20.510829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:21.004493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25328): Launched 04:17:21.114240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:21.356552 run patchelf(pid=25329): Launched 04:17:21.515664 run osmo-stp_10.42.42.5(pid=25326): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25326)] 04:17:21.637987 run osmo-stp_10.42.42.5(pid=25326): stdout: | (launched: 2022-12-10_04:17:20.350642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:21.761953 run osmo-stp_10.42.42.5(pid=25326): stderr: | 20221210041720519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041720520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041720520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041720520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041720521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041720521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041720521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:21.885580 run osmo-stp_10.42.42.5(pid=25326): stdout: | (launched: 2022-12-10_04:17:20.350642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:22.003625 run osmo-stp_10.42.42.5(pid=25326): stderr: | 20221210041720519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041720520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041720520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041720520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041720521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041720521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041720521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:22.143464 run patchelf(pid=25329): Terminating (SIGINT) 04:17:22.305239 run patchelf(pid=25329): Terminated: ok {rc=0} 04:17:22.421987 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25326): Process ended prematurely: osmo-stp_10.42.42.5(pid=25326) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25326)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 04:17:22.430883 tst ping.py:22: Test FAILED (6.2 sec) 04:17:22.457843 run osmo-hlr_10.42.42.2(pid=25323): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25323)] 04:17:22.504645 run osmo-hlr_10.42.42.2(pid=25323): stdout: | (launched: 2022-12-10_04:17:19.447424) 04:17:22.553502 run osmo-hlr_10.42.42.2(pid=25323): stderr: | 20221210041719621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041719621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041719621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041719621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041719621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041719621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041719634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041719642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041719642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041719642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:22.602719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25322): Terminating (SIGTERM) 04:17:22.642028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25325): Terminating (SIGTERM) 04:17:22.681282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25328): Terminating (SIGTERM) 04:17:22.720763 --- ParallelTerminationStrategy: PID 25322 died... 04:17:22.739552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25322): Terminated: ok {rc=0} 04:17:22.783392 --- ParallelTerminationStrategy: PID 25325 died... 04:17:22.801826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25325): Terminated: ok {rc=0} 04:17:22.845331 --- ParallelTerminationStrategy: PID 25328 died... 04:17:22.863588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25328): Terminated: ok {rc=0} 04:17:22.947847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:17:24.034691 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.046257 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:24.118482 tst ping_idle_ping.py: using LAC 25931 04:17:24.232664 tst ping_idle_ping.py: using RAC 176 04:17:24.347970 tst ping_idle_ping.py: using CellId 25931 04:17:24.472000 tst ping_idle_ping.py: using BVCI 25932 04:17:24.585785 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.597311 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.608549 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.619974 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.631234 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.642917 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.654325 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:24.666158 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:24.777336 tst ping_idle_ping.py:24: start network... 04:17:24.970044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:25.415101 run create_hlr_db(pid=25330): Launched 04:17:25.524573 bus /gobi_6: Setting Powered False 04:17:26.583050 run create_hlr_db(pid=25330): Terminated: ok {rc=0} 04:17:27.003295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25332): Launched 04:17:27.310726 run osmo-hlr_10.42.42.2(pid=25333): Launched 04:17:27.428294 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:27.956590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25335): Launched 04:17:28.263732 run osmo-stp_10.42.42.5(pid=25336): Launched 04:17:28.380853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:28.911995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25338): Launched 04:17:29.029494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:29.288034 run patchelf(pid=25339): Launched 04:17:29.458789 run osmo-stp_10.42.42.5(pid=25336): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25336)] 04:17:29.589731 run osmo-stp_10.42.42.5(pid=25336): stdout: | (launched: 2022-12-10_04:17:28.207585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:29.721625 run osmo-stp_10.42.42.5(pid=25336): stderr: | 20221210041728395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041728395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041728395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041728396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041728396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041728396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041728396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:29.853475 run osmo-stp_10.42.42.5(pid=25336): stdout: | (launched: 2022-12-10_04:17:28.207585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:29.980367 run osmo-stp_10.42.42.5(pid=25336): stderr: | 20221210041728395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041728395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041728395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041728396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041728396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041728396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041728396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:30.130165 run patchelf(pid=25339): Terminating (SIGINT) 04:17:30.302326 run patchelf(pid=25339): Terminated: ok {rc=0} 04:17:30.426758 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25336): Process ended prematurely: osmo-stp_10.42.42.5(pid=25336) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25336)] [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:17:30.436385 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:17:30.464225 run osmo-hlr_10.42.42.2(pid=25333): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25333)] 04:17:30.513135 run osmo-hlr_10.42.42.2(pid=25333): stdout: | (launched: 2022-12-10_04:17:27.255232) 04:17:30.564007 run osmo-hlr_10.42.42.2(pid=25333): stderr: | 20221210041727451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041727451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041727451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041727451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041727451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041727451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041727465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041727473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041727474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041727474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:30.615391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25332): Terminating (SIGTERM) 04:17:30.656641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25335): Terminating (SIGTERM) 04:17:30.697998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25338): Terminating (SIGTERM) 04:17:30.739412 --- ParallelTerminationStrategy: PID 25332 died... 04:17:30.759107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25332): Terminated: ok {rc=0} 04:17:30.804734 --- ParallelTerminationStrategy: PID 25335 died... 04:17:30.824062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25335): Terminated: ok {rc=0} 04:17:30.875961 --- ParallelTerminationStrategy: PID 25338 died... 04:17:30.896190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25338): Terminated: ok {rc=0} 04:17:30.989236 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:17:32.311499 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:17:32.318808 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:17:32.357620 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:17:32.395965 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:17:32.480297 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:17:32.512509 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:17:32.550753 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:17:33.156772 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:17:33.205044 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.216348 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:17:33.266450 tst cs_paging_gprs_active.py: using LAC 25932 04:17:33.381832 tst cs_paging_gprs_active.py: using RAC 177 04:17:33.495601 tst cs_paging_gprs_active.py: using CellId 25932 04:17:33.618799 tst cs_paging_gprs_active.py: using BVCI 25933 04:17:33.733833 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.745695 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.757377 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.769166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.780909 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.793060 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.804829 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.816378 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:33.828251 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:17:33.944211 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:17:34.057440 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:17:34.253761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:34.546868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25343): Launched 04:17:34.801402 run iperf3-srv_10.42.42.10(pid=25344): Launched 04:17:34.910785 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:17:35.106747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:35.400050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25345): Launched 04:17:35.654812 run iperf3-srv_10.42.42.10(pid=25346): Launched 04:17:35.764115 tst cs_paging_gprs_active.py:38: start network... 04:17:35.962774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:36.415036 run create_hlr_db(pid=25354): Launched 04:17:36.528300 bus /gobi_6: Setting Powered False 04:17:37.587115 run create_hlr_db(pid=25354): Terminated: ok {rc=0} 04:17:37.996312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25356): Launched 04:17:38.288865 run osmo-hlr_10.42.42.2(pid=25357): Launched 04:17:38.400515 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:38.920089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25359): Launched 04:17:39.211210 run osmo-stp_10.42.42.5(pid=25360): Launched 04:17:39.322311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:39.825980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25362): Launched 04:17:39.937619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:40.203352 run patchelf(pid=25363): Launched 04:17:40.377147 run osmo-stp_10.42.42.5(pid=25360): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25360)] 04:17:40.509267 run osmo-stp_10.42.42.5(pid=25360): stdout: | (launched: 2022-12-10_04:17:39.158247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:40.643644 run osmo-stp_10.42.42.5(pid=25360): stderr: | 20221210041739326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041739326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041739327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041739327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041739329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041739329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041739329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:40.778029 run osmo-stp_10.42.42.5(pid=25360): stdout: | (launched: 2022-12-10_04:17:39.158247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:40.906475 run osmo-stp_10.42.42.5(pid=25360): stderr: | 20221210041739326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041739326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041739327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041739327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041739329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041739329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041739329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:41.058142 run patchelf(pid=25363): Terminating (SIGINT) 04:17:41.232555 run patchelf(pid=25363): Terminated: ok {rc=0} 04:17:41.358771 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25360): Process ended prematurely: osmo-stp_10.42.42.5(pid=25360) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25360)] [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:17:41.369169 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 04:17:41.397352 run osmo-hlr_10.42.42.2(pid=25357): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25357)] 04:17:41.446295 run osmo-hlr_10.42.42.2(pid=25357): stdout: | (launched: 2022-12-10_04:17:38.235186) 04:17:41.497449 run osmo-hlr_10.42.42.2(pid=25357): stderr: | 20221210041738411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041738411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041738411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041738411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041738411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041738411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041738424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041738434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041738434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041738434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:41.549097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25343): Terminating (SIGTERM) 04:17:41.589908 run iperf3-srv_10.42.42.10(pid=25344): Terminating (SIGTERM) 04:17:41.630844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25345): Terminating (SIGTERM) 04:17:41.671805 run iperf3-srv_10.42.42.10(pid=25346): Terminating (SIGTERM) 04:17:41.712647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25356): Terminating (SIGTERM) 04:17:41.753645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25359): Terminating (SIGTERM) 04:17:41.794549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25362): Terminating (SIGTERM) 04:17:41.835681 --- ParallelTerminationStrategy: PID 25343 died... 04:17:41.855286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25343): Terminated: ok {rc=0} 04:17:41.901671 --- ParallelTerminationStrategy: PID 25344 died... 04:17:41.920784 run iperf3-srv_10.42.42.10(pid=25344): Terminated {rc=256} 04:17:41.965949 --- ParallelTerminationStrategy: PID 25345 died... 04:17:41.985078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25345): Terminated: ok {rc=0} 04:17:42.030476 --- ParallelTerminationStrategy: PID 25346 died... 04:17:42.049656 run iperf3-srv_10.42.42.10(pid=25346): Terminated {rc=256} 04:17:42.094522 --- ParallelTerminationStrategy: PID 25356 died... 04:17:42.113612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25356): Terminated: ok {rc=0} 04:17:42.158379 --- ParallelTerminationStrategy: PID 25359 died... 04:17:42.177458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25359): Terminated: ok {rc=0} 04:17:42.222501 --- ParallelTerminationStrategy: PID 25362 died... 04:17:42.241371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25362): Terminated: ok {rc=0} 04:17:42.327684 bus /gobi_0: Setting Powered False 04:17:43.426009 bus /gobi_0: Setting Powered False 04:17:44.542455 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:17:45.690201 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:45.702619 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:17:45.762456 tst iperf3.py: using LAC 25933 04:17:45.905546 tst iperf3.py: using RAC 178 04:17:46.031367 tst iperf3.py: using CellId 25933 04:17:46.195881 tst iperf3.py: using BVCI 25934 04:17:46.348382 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.361606 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.374161 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.388376 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.400881 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.414494 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.427905 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.442468 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:46.456146 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:17:46.573548 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:17:46.777145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:47.085285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25364): Launched 04:17:47.359179 run iperf3-srv_10.42.42.10(pid=25365): Launched 04:17:47.469661 tst iperf3.py:8: start network... 04:17:47.667484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:48.121227 run create_hlr_db(pid=25366): Launched 04:17:48.231933 bus /gobi_6: Setting Powered False 04:17:49.290247 run create_hlr_db(pid=25366): Terminated: ok {rc=0} 04:17:49.716932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25368): Launched 04:17:50.029158 run osmo-hlr_10.42.42.2(pid=25369): Launched 04:17:50.147599 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:50.685089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25371): Launched 04:17:50.995968 run osmo-stp_10.42.42.5(pid=25372): Launched 04:17:51.114583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:51.652183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25374): Launched 04:17:51.771638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:52.035156 run patchelf(pid=25375): Launched 04:17:52.208029 run osmo-stp_10.42.42.5(pid=25372): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25372)] 04:17:52.341133 run osmo-stp_10.42.42.5(pid=25372): stdout: | (launched: 2022-12-10_04:17:50.939643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:52.475787 run osmo-stp_10.42.42.5(pid=25372): stderr: | 20221210041751128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041751129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041751129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041751129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041751130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041751130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041751130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:52.610371 run osmo-stp_10.42.42.5(pid=25372): stdout: | (launched: 2022-12-10_04:17:50.939643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:52.738873 run osmo-stp_10.42.42.5(pid=25372): stderr: | 20221210041751128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041751129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041751129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041751129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041751130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041751130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041751130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:52.891033 run patchelf(pid=25375): Terminating (SIGINT) 04:17:53.066633 run patchelf(pid=25375): Terminated: ok {rc=0} 04:17:53.193329 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25372): Process ended prematurely: osmo-stp_10.42.42.5(pid=25372) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25372)] [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:17:53.203597 tst iperf3.py:8: Test FAILED (7.6 sec) 04:17:53.231929 run osmo-hlr_10.42.42.2(pid=25369): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25369)] 04:17:53.281135 run osmo-hlr_10.42.42.2(pid=25369): stdout: | (launched: 2022-12-10_04:17:49.972747) 04:17:53.331737 run osmo-hlr_10.42.42.2(pid=25369): stderr: | 20221210041750169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041750170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041750170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041750170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041750170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041750170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041750182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041750191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041750191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041750191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:53.382869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25364): Terminating (SIGTERM) 04:17:53.424026 run iperf3-srv_10.42.42.10(pid=25365): Terminating (SIGTERM) 04:17:53.466476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25368): Terminating (SIGTERM) 04:17:53.507917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25371): Terminating (SIGTERM) 04:17:53.549089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25374): Terminating (SIGTERM) 04:17:53.590344 --- ParallelTerminationStrategy: PID 25364 died... 04:17:53.610113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25364): Terminated: ok {rc=0} 04:17:53.655669 --- ParallelTerminationStrategy: PID 25365 died... 04:17:53.674732 run iperf3-srv_10.42.42.10(pid=25365): Terminated {rc=256} 04:17:53.719888 --- ParallelTerminationStrategy: PID 25368 died... 04:17:53.739184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25368): Terminated: ok {rc=0} 04:17:53.784311 --- ParallelTerminationStrategy: PID 25371 died... 04:17:53.803648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25371): Terminated: ok {rc=0} 04:17:53.848588 --- ParallelTerminationStrategy: PID 25374 died... 04:17:53.867873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25374): Terminated: ok {rc=0} 04:17:53.954190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:17:55.100806 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.113166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:17:55.167038 tst iperf3m4.py: using LAC 25934 04:17:55.289685 tst iperf3m4.py: using RAC 179 04:17:55.411028 tst iperf3m4.py: using CellId 25934 04:17:55.532484 tst iperf3m4.py: using BVCI 25935 04:17:55.645768 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.657480 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.668823 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.680361 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.691867 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.703305 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.714848 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.726296 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:17:55.737913 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:17:55.853091 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:17:55.973084 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:17:56.088674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:17:56.202203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:17:56.399336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:56.692365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25376): Launched 04:17:56.946849 run iperf3-srv_10.42.42.10(pid=25377): Launched 04:17:57.056482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:17:57.252279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:57.544429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25378): Launched 04:17:57.798657 run iperf3-srv_10.42.42.10(pid=25379): Launched 04:17:57.911016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:17:58.106599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:58.400255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25380): Launched 04:17:58.653141 run iperf3-srv_10.42.42.10(pid=25381): Launched 04:17:58.762329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:17:58.958065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:59.250667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25382): Launched 04:17:59.504480 run iperf3-srv_10.42.42.10(pid=25383): Launched 04:17:59.613478 tst iperf3m4.py:8: start network... 04:17:59.810356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:00.261722 run create_hlr_db(pid=25384): Launched 04:18:00.374585 bus /gobi_6: Setting Powered False 04:18:01.442041 run create_hlr_db(pid=25384): Terminated: ok {rc=0} 04:18:01.893278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25386): Launched 04:18:02.218515 run osmo-hlr_10.42.42.2(pid=25387): Launched 04:18:02.338243 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:02.875152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25389): Launched 04:18:03.185853 run osmo-stp_10.42.42.5(pid=25390): Launched 04:18:03.304377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:03.842518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25392): Launched 04:18:03.961919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:04.224910 run patchelf(pid=25393): Launched 04:18:04.397950 run osmo-stp_10.42.42.5(pid=25390): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25390)] 04:18:04.530074 run osmo-stp_10.42.42.5(pid=25390): stdout: | (launched: 2022-12-10_04:18:03.129709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:04.663703 run osmo-stp_10.42.42.5(pid=25390): stderr: | 20221210041803317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041803318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041803318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041803318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041803319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041803319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041803319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:04.797188 run osmo-stp_10.42.42.5(pid=25390): stdout: | (launched: 2022-12-10_04:18:03.129709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:04.925216 run osmo-stp_10.42.42.5(pid=25390): stderr: | 20221210041803317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041803318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041803318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041803318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041803319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041803319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041803319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:05.076698 run patchelf(pid=25393): Terminating (SIGINT) 04:18:05.251444 run patchelf(pid=25393): Terminated: ok {rc=0} 04:18:05.377715 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25390): Process ended prematurely: osmo-stp_10.42.42.5(pid=25390) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25390)] [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:18:05.388118 tst iperf3m4.py:8: Test FAILED (10.3 sec) 04:18:05.416748 run osmo-hlr_10.42.42.2(pid=25387): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25387)] 04:18:05.466031 run osmo-hlr_10.42.42.2(pid=25387): stdout: | (launched: 2022-12-10_04:18:02.161953) 04:18:05.516921 run osmo-hlr_10.42.42.2(pid=25387): stderr: | 20221210041802356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041802356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041802356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041802356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041802356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041802356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041802368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041802376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041802376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041802377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:05.568277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25376): Terminating (SIGTERM) 04:18:05.609655 run iperf3-srv_10.42.42.10(pid=25377): Terminating (SIGTERM) 04:18:05.650738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25378): Terminating (SIGTERM) 04:18:05.692110 run iperf3-srv_10.42.42.10(pid=25379): Terminating (SIGTERM) 04:18:05.734610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25380): Terminating (SIGTERM) 04:18:05.776181 run iperf3-srv_10.42.42.10(pid=25381): Terminating (SIGTERM) 04:18:05.817091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25382): Terminating (SIGTERM) 04:18:05.858078 run iperf3-srv_10.42.42.10(pid=25383): Terminating (SIGTERM) 04:18:05.899205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25386): Terminating (SIGTERM) 04:18:05.940197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25389): Terminating (SIGTERM) 04:18:05.981265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25392): Terminating (SIGTERM) 04:18:06.022424 --- ParallelTerminationStrategy: PID 25376 died... 04:18:06.042008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25376): Terminated: ok {rc=0} 04:18:06.087660 --- ParallelTerminationStrategy: PID 25377 died... 04:18:06.106974 run iperf3-srv_10.42.42.10(pid=25377): Terminated {rc=256} 04:18:06.152073 --- ParallelTerminationStrategy: PID 25378 died... 04:18:06.171425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25378): Terminated: ok {rc=0} 04:18:06.216840 --- ParallelTerminationStrategy: PID 25379 died... 04:18:06.236285 run iperf3-srv_10.42.42.10(pid=25379): Terminated {rc=256} 04:18:06.281373 --- ParallelTerminationStrategy: PID 25380 died... 04:18:06.300597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25380): Terminated: ok {rc=0} 04:18:06.346080 --- ParallelTerminationStrategy: PID 25381 died... 04:18:06.365380 run iperf3-srv_10.42.42.10(pid=25381): Terminated {rc=256} 04:18:06.410462 --- ParallelTerminationStrategy: PID 25382 died... 04:18:06.429810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25382): Terminated: ok {rc=0} 04:18:06.474949 --- ParallelTerminationStrategy: PID 25383 died... 04:18:06.493990 run iperf3-srv_10.42.42.10(pid=25383): Terminated {rc=256} 04:18:06.539077 --- ParallelTerminationStrategy: PID 25386 died... 04:18:06.558398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25386): Terminated: ok {rc=0} 04:18:06.603587 --- ParallelTerminationStrategy: PID 25389 died... 04:18:06.622884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25389): Terminated: ok {rc=0} 04:18:06.668189 --- ParallelTerminationStrategy: PID 25392 died... 04:18:06.687602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25392): Terminated: ok {rc=0} 04:18:06.772916 bus /gobi_4: Setting Powered False 04:18:07.869833 bus /gobi_4: Setting Powered False 04:18:08.983697 bus /gobi_1: Setting Powered False 04:18:10.082571 bus /gobi_1: Setting Powered False 04:18:11.197681 bus /gobi_0: Setting Powered False 04:18:12.296217 bus /gobi_0: Setting Powered False 04:18:13.408911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:18:14.509662 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:14.522111 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:14.575661 tst ping.py: using LAC 25935 04:18:14.697440 tst ping.py: using RAC 180 04:18:14.817248 tst ping.py: using CellId 25935 04:18:14.937205 tst ping.py: using BVCI 25936 04:18:15.049845 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:15.061658 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:15.073164 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:15.084688 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:15.096209 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:15.107726 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:15.119289 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:15.130753 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:15.247297 tst ping.py:19: start network... 04:18:15.454200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:15.931887 run create_hlr_db(pid=25394): Launched 04:18:16.090988 bus /gobi_6: Setting Powered False 04:18:17.149190 run create_hlr_db(pid=25394): Terminated: ok {rc=0} 04:18:17.596305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25396): Launched 04:18:17.901959 run osmo-hlr_10.42.42.2(pid=25397): Launched 04:18:18.018083 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:18.549207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25399): Launched 04:18:18.854384 run osmo-stp_10.42.42.5(pid=25400): Launched 04:18:18.971132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:19.499668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25402): Launched 04:18:19.616660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:19.875620 run patchelf(pid=25403): Launched 04:18:20.046500 run osmo-stp_10.42.42.5(pid=25400): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25400)] 04:18:20.176641 run osmo-stp_10.42.42.5(pid=25400): stdout: | (launched: 2022-12-10_04:18:18.798943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:20.308020 run osmo-stp_10.42.42.5(pid=25400): stderr: | 20221210041818987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041818987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041818987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041818988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041818988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041818988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041818988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:20.439516 run osmo-stp_10.42.42.5(pid=25400): stdout: | (launched: 2022-12-10_04:18:18.798943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:20.565448 run osmo-stp_10.42.42.5(pid=25400): stderr: | 20221210041818987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041818987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041818987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041818988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041818988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041818988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041818988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:20.714323 run patchelf(pid=25403): Terminating (SIGINT) 04:18:20.885584 run patchelf(pid=25403): Terminated: ok {rc=0} 04:18:21.009932 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25400): Process ended prematurely: osmo-stp_10.42.42.5(pid=25400) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25400)] [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:18:21.019780 tst ping.py:22: Test FAILED (6.5 sec) 04:18:21.048235 run osmo-hlr_10.42.42.2(pid=25397): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25397)] 04:18:21.097629 run osmo-hlr_10.42.42.2(pid=25397): stdout: | (launched: 2022-12-10_04:18:17.846430) 04:18:21.148771 run osmo-hlr_10.42.42.2(pid=25397): stderr: | 20221210041818041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041818041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041818041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041818041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041818041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041818041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041818054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041818062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041818062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041818063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:21.200442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25396): Terminating (SIGTERM) 04:18:21.241923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25399): Terminating (SIGTERM) 04:18:21.283332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25402): Terminating (SIGTERM) 04:18:21.325052 --- ParallelTerminationStrategy: PID 25396 died... 04:18:21.344567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25396): Terminated: ok {rc=0} 04:18:21.390731 --- ParallelTerminationStrategy: PID 25399 died... 04:18:21.410250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25399): Terminated: ok {rc=0} 04:18:21.455903 --- ParallelTerminationStrategy: PID 25402 died... 04:18:21.475386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25402): Terminated: ok {rc=0} 04:18:21.562071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:18:22.649265 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.661716 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:22.717472 tst ping_idle_ping.py: using LAC 25936 04:18:22.839391 tst ping_idle_ping.py: using RAC 181 04:18:22.960462 tst ping_idle_ping.py: using CellId 25936 04:18:23.080828 tst ping_idle_ping.py: using BVCI 25937 04:18:23.192324 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:23.204279 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:23.216015 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:23.227908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:23.239684 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:23.251565 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:23.263324 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:23.275308 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:23.392649 tst ping_idle_ping.py:24: start network... 04:18:23.599450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:24.077404 run create_hlr_db(pid=25404): Launched 04:18:24.202063 bus /gobi_6: Setting Powered False 04:18:25.263821 run create_hlr_db(pid=25404): Terminated: ok {rc=0} 04:18:25.677809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25406): Launched 04:18:25.965226 run osmo-hlr_10.42.42.2(pid=25407): Launched 04:18:26.074996 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:26.587562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Launched 04:18:26.873766 run osmo-stp_10.42.42.5(pid=25410): Launched 04:18:26.983284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:27.480167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25412): Launched 04:18:27.591581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:27.835044 run patchelf(pid=25413): Launched 04:18:27.995556 run osmo-stp_10.42.42.5(pid=25410): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] 04:18:28.117842 run osmo-stp_10.42.42.5(pid=25410): stdout: | (launched: 2022-12-10_04:18:26.821793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:28.241237 run osmo-stp_10.42.42.5(pid=25410): stderr: | 20221210041826987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041826988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041826988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041826988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041826990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041826991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041826991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:28.365215 run osmo-stp_10.42.42.5(pid=25410): stdout: | (launched: 2022-12-10_04:18:26.821793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:28.483227 run osmo-stp_10.42.42.5(pid=25410): stderr: | 20221210041826987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041826988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041826988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041826988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041826990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041826991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041826991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:28.623608 run patchelf(pid=25413): Terminating (SIGINT) 04:18:28.785656 run patchelf(pid=25413): Terminated: ok {rc=0} 04:18:28.902762 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25410): Process ended prematurely: osmo-stp_10.42.42.5(pid=25410) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:18:28.911787 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:18:28.939001 run osmo-hlr_10.42.42.2(pid=25407): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25407)] 04:18:28.986415 run osmo-hlr_10.42.42.2(pid=25407): stdout: | (launched: 2022-12-10_04:18:25.912265) 04:18:29.035331 run osmo-hlr_10.42.42.2(pid=25407): stderr: | 20221210041826086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041826086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041826087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041826087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041826087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041826087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041826099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041826109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041826109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041826109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:29.085176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25406): Terminating (SIGTERM) 04:18:29.124519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Terminating (SIGTERM) 04:18:29.164222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25412): Terminating (SIGTERM) 04:18:29.204062 --- ParallelTerminationStrategy: PID 25406 died... 04:18:29.222999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25406): Terminated: ok {rc=0} 04:18:29.267629 --- ParallelTerminationStrategy: PID 25409 died... 04:18:29.286148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Terminated: ok {rc=0} 04:18:29.330266 --- ParallelTerminationStrategy: PID 25412 died... 04:18:29.348916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25412): Terminated: ok {rc=0} 04:18:29.434407 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:18:30.739605 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:18:30.746216 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:18:30.778934 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:18:30.814366 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:18:30.871239 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:18:30.906822 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:18:30.951356 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:18:31.507780 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:18:31.514390 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:31.526564 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:18:31.600095 tst switch_tch_pdch.py: using LAC 25937 04:18:31.754713 tst switch_tch_pdch.py: using RAC 182 04:18:31.870924 tst switch_tch_pdch.py: using CellId 25937 04:18:31.993753 tst switch_tch_pdch.py: using BVCI 25938 04:18:32.142450 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:32.158971 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:32.173520 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:32.187785 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:32.201037 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:32.214245 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:32.226398 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:18:32.239584 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:18:32.361212 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:18:32.478672 tst switch_tch_pdch.py:51: start network... 04:18:32.686141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:33.159025 run create_hlr_db(pid=25417): Launched 04:18:33.282419 bus /gobi_6: Setting Powered False 04:18:34.343155 run create_hlr_db(pid=25417): Terminated: ok {rc=0} 04:18:34.754298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25419): Launched 04:18:35.040287 run osmo-hlr_10.42.42.2(pid=25420): Launched 04:18:35.149724 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:35.653014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25422): Launched 04:18:35.940660 run osmo-stp_10.42.42.5(pid=25423): Launched 04:18:36.049683 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:36.544850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25425): Launched 04:18:36.654938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:36.897110 run patchelf(pid=25426): Launched 04:18:37.057147 run osmo-stp_10.42.42.5(pid=25423): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25423)] 04:18:37.179985 run osmo-stp_10.42.42.5(pid=25423): stdout: | (launched: 2022-12-10_04:18:35.886775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:37.304232 run osmo-stp_10.42.42.5(pid=25423): stderr: | 20221210041836053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041836054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041836054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041836054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041836057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041836057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041836057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:37.428749 run osmo-stp_10.42.42.5(pid=25423): stdout: | (launched: 2022-12-10_04:18:35.886775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:37.548127 run osmo-stp_10.42.42.5(pid=25423): stderr: | 20221210041836053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041836054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041836054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041836054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041836057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041836057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041836057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:37.688375 run patchelf(pid=25426): Terminating (SIGINT) 04:18:37.850494 run patchelf(pid=25426): Terminated: ok {rc=0} 04:18:37.968268 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25423): Process ended prematurely: osmo-stp_10.42.42.5(pid=25423) [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25423)] [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:18:37.977514 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:18:38.004533 run osmo-hlr_10.42.42.2(pid=25420): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25420)] 04:18:38.051810 run osmo-hlr_10.42.42.2(pid=25420): stdout: | (launched: 2022-12-10_04:18:34.987947) 04:18:38.100853 run osmo-hlr_10.42.42.2(pid=25420): stderr: | 20221210041835160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041835160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041835160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041835160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041835160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041835160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041835172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041835181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041835181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041835181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:38.150453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25419): Terminating (SIGTERM) 04:18:38.190316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25422): Terminating (SIGTERM) 04:18:38.230684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25425): Terminating (SIGTERM) 04:18:38.271430 --- ParallelTerminationStrategy: PID 25419 died... 04:18:38.290753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25419): Terminated: ok {rc=0} 04:18:38.335002 --- ParallelTerminationStrategy: PID 25422 died... 04:18:38.353421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25422): Terminated: ok {rc=0} 04:18:38.397676 --- ParallelTerminationStrategy: PID 25425 died... 04:18:38.416047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25425): Terminated: ok {rc=0} 04:18:38.498474 bus /gobi_0: Setting Powered False 04:18:39.595894 bus /gobi_0: Setting Powered False 04:18:40.711065 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:18:41.963885 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:18:41.971075 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:18:42.005080 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:18:42.039286 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:18:42.093280 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:18:42.126188 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:18:42.160350 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:18:42.712889 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:18:42.717932 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:42.728626 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:18:42.796069 tst switch_tch_pdch.py: using LAC 25938 04:18:42.909369 tst switch_tch_pdch.py: using RAC 183 04:18:43.021189 tst switch_tch_pdch.py: using CellId 25938 04:18:43.134264 tst switch_tch_pdch.py: using BVCI 25939 04:18:43.240067 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:43.251004 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:43.261666 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:43.272533 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:43.283367 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:43.294320 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:43.305385 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:18:43.316178 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:18:43.431305 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:18:43.544466 tst switch_tch_pdch.py:51: start network... 04:18:43.737366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:44.157701 run create_hlr_db(pid=25430): Launched 04:18:44.266836 bus /gobi_6: Setting Powered False 04:18:45.324583 run create_hlr_db(pid=25430): Terminated: ok {rc=0} 04:18:45.717941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25432): Launched 04:18:46.046750 run osmo-hlr_10.42.42.2(pid=25433): Launched 04:18:46.297162 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:47.077730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25435): Launched 04:18:47.393646 run osmo-stp_10.42.42.5(pid=25436): Launched 04:18:47.510200 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:47.996942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25438): Launched 04:18:48.107310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:48.349193 run patchelf(pid=25439): Launched 04:18:48.508509 run osmo-stp_10.42.42.5(pid=25436): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25436)] 04:18:48.630628 run osmo-stp_10.42.42.5(pid=25436): stdout: | (launched: 2022-12-10_04:18:47.331151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:48.754097 run osmo-stp_10.42.42.5(pid=25436): stderr: | 20221210041847541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041847541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041847541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041847542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041847542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041847542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041847542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:48.877690 run osmo-stp_10.42.42.5(pid=25436): stdout: | (launched: 2022-12-10_04:18:47.331151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:48.995452 run osmo-stp_10.42.42.5(pid=25436): stderr: | 20221210041847541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041847541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041847541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041847542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041847542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041847542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041847542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:49.135447 run patchelf(pid=25439): Terminating (SIGINT) 04:18:49.296770 run patchelf(pid=25439): Terminated: ok {rc=0} 04:18:49.413081 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25436): Process ended prematurely: osmo-stp_10.42.42.5(pid=25436) [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25436)] [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:18:49.422071 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:18:49.448694 run osmo-hlr_10.42.42.2(pid=25433): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25433)] 04:18:49.495781 run osmo-hlr_10.42.42.2(pid=25433): stdout: | (launched: 2022-12-10_04:18:45.992069) 04:18:49.544233 run osmo-hlr_10.42.42.2(pid=25433): stderr: | 20221210041846199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041846199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041846199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041846199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041846199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041846199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041846214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041846225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041846226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041846226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:49.593217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25432): Terminating (SIGTERM) 04:18:49.632445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25435): Terminating (SIGTERM) 04:18:49.671648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25438): Terminating (SIGTERM) 04:18:49.710771 --- ParallelTerminationStrategy: PID 25432 died... 04:18:49.729667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25432): Terminated: ok {rc=0} 04:18:49.773478 --- ParallelTerminationStrategy: PID 25435 died... 04:18:49.791720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25435): Terminated: ok {rc=0} 04:18:49.835835 --- ParallelTerminationStrategy: PID 25438 died... 04:18:49.854323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25438): Terminated: ok {rc=0} 04:18:49.936433 bus /gobi_0: Setting Powered False 04:18:51.033678 bus /gobi_0: Setting Powered False 04:18:52.148274 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_sms:trx-lms --------------------------------------------------------------------- 04:18:53.400537 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:18:53.404695 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 04:18:53.438662 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 04:18:53.445642 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 04:18:53.499504 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 04:18:53.533190 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 04:18:53.539980 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 04:18:54.077681 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 04:18:54.082805 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 04:18:54.093958 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 04:18:54.142409 tst mo_mt_sms.py: using LAC 25939 04:18:54.264078 tst mo_mt_sms.py: using RAC 184 04:18:54.384160 tst mo_mt_sms.py: using CellId 25939 04:18:54.505387 tst mo_mt_sms.py: using BVCI 25940 04:18:54.615594 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 04:18:54.727616 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 04:18:54.841236 tst mo_mt_sms.py:9: start nitb and bts... 04:18:55.048664 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:18:55.670523 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25443): Launched 04:18:55.973808 run osmo-nitb_10.42.42.2(pid=25444): Launched 04:18:56.142882 run osmo-nitb_10.42.42.2(pid=25444): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25444)] 04:18:56.279570 run osmo-nitb_10.42.42.2(pid=25444): stdout: | (launched: 2022-12-10_04:18:55.918605) 04:18:56.418178 run osmo-nitb_10.42.42.2(pid=25444): stderr: | (launched: 2022-12-10_04:18:55.964175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:18:56.556359 run osmo-nitb_10.42.42.2(pid=25444): stdout: | (launched: 2022-12-10_04:18:55.918605) 04:18:56.697682 run osmo-nitb_10.42.42.2(pid=25444): stderr: | (launched: 2022-12-10_04:18:55.964175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25444): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25444) [trial-2369↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25444)] 04:18:57.088725 tst osmo-nitb_10.42.42.2(pid=25444): stdout: | (launched: 2022-12-10_04:18:55.918605) 04:18:57.212042 tst osmo-nitb_10.42.42.2(pid=25444): stderr: | (launched: 2022-12-10_04:18:55.964175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:18:57.357672 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25444): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25444) [trial-2369↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25444)] [trial-2369↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 04:18:57.366642 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:18:57.373719 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25443): Terminating (SIGTERM) 04:18:57.584662 --- ParallelTerminationStrategy: PID 25443 died... 04:18:57.605618 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25443): Terminated: ok {rc=0} 04:18:57.692411 bus /sierra_3: Setting Powered False 04:18:58.790546 bus /sierra_3: Setting Powered False 04:18:59.906760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:trx-lms --------------------------------------------------------------------- 04:19:01.107974 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:01.113659 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 04:19:01.161177 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:19:01.198277 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 04:19:01.261095 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 04:19:01.299926 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:19:01.328585 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 04:19:01.889701 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 04:19:01.898232 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:01.912700 tst sms:trx-lms: Using 1 x bts (candidates: 1) 04:19:01.977531 tst mo_mt_sms.py: using LAC 25940 04:19:02.094722 tst mo_mt_sms.py: using RAC 185 04:19:02.223748 tst mo_mt_sms.py: using CellId 25940 04:19:02.337371 tst mo_mt_sms.py: using BVCI 25941 04:19:02.441623 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:02.452226 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:02.462790 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:02.474016 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:02.485381 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:02.496604 tst sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:02.608735 tst sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:02.723078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:03.165808 run create_hlr_db(pid=25449): Launched 04:19:03.274511 bus /sierra_2: Setting Powered False 04:19:04.332387 run create_hlr_db(pid=25449): Terminated: ok {rc=0} 04:19:04.749647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25451): Launched 04:19:05.053635 run osmo-hlr_10.42.42.2(pid=25452): Launched 04:19:05.169613 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:05.699292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25454): Launched 04:19:06.003386 run osmo-stp_10.42.42.5(pid=25455): Launched 04:19:06.119745 run osmo-msc_10.42.42.6: Starting osmo-msc 04:19:06.673146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25457): Launched 04:19:06.977426 run osmo-msc_10.42.42.6(pid=25458): Launched 04:19:07.147298 run osmo-stp_10.42.42.5(pid=25455): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25455)] 04:19:07.276141 run osmo-stp_10.42.42.5(pid=25455): stdout: | (launched: 2022-12-10_04:19:05.947816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:07.405804 run osmo-stp_10.42.42.5(pid=25455): stderr: | 20221210041906137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041906137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041906137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041906138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041906138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041906138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041906138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:07.535323 run osmo-stp_10.42.42.5(pid=25455): stdout: | (launched: 2022-12-10_04:19:05.947816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:07.657282 run osmo-stp_10.42.42.5(pid=25455): stderr: | 20221210041906137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041906137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041906137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041906138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041906138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041906138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041906138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:07.803238 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25455): Process ended prematurely: osmo-stp_10.42.42.5(pid=25455) [trial-2369↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25455)] [trial-2369↪sms:trx-lms↪mo_mt_sms.py:16] 04:19:07.812181 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 04:19:07.839107 run osmo-hlr_10.42.42.2(pid=25452): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25452)] 04:19:07.888175 run osmo-hlr_10.42.42.2(pid=25452): stdout: | (launched: 2022-12-10_04:19:04.998662) 04:19:07.939540 run osmo-hlr_10.42.42.2(pid=25452): stderr: | 20221210041905191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041905191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041905191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041905191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041905191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041905192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041905204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041905212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041905212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041905213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:08.010410 run osmo-msc_10.42.42.6(pid=25458): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25458)] 04:19:08.059252 run osmo-msc_10.42.42.6(pid=25458): stdout: | (launched: 2022-12-10_04:19:06.921470) 04:19:08.109883 run osmo-msc_10.42.42.6(pid=25458): stderr: | 20221210041907241 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041907241 DLGLOBAL DEBUG validating counter group 0x7f36a6110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041907241 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041907242 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041907242 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041907242 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041907243 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041907244 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041907244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041907244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:19:08.160928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25451): Terminating (SIGTERM) 04:19:08.202809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25454): Terminating (SIGTERM) 04:19:08.243720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25457): Terminating (SIGTERM) 04:19:08.284826 --- ParallelTerminationStrategy: PID 25451 died... 04:19:08.304436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25451): Terminated: ok {rc=0} 04:19:08.349769 --- ParallelTerminationStrategy: PID 25454 died... 04:19:08.368735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25454): Terminated: ok {rc=0} 04:19:08.413725 --- ParallelTerminationStrategy: PID 25457 died... 04:19:08.432751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25457): Terminated: ok {rc=0} 04:19:08.517714 bus /sierra_3: Setting Powered False 04:19:09.613507 bus /sierra_3: Setting Powered False 04:19:10.727776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-lms --------------------------------------------------------------------- 04:19:11.952335 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:11.955954 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 04:19:11.990310 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 04:19:11.997059 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 04:19:12.032111 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 04:19:12.065987 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 04:19:12.073402 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 04:19:12.593091 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 04:19:12.599042 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 04:19:12.610285 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 04:19:12.660359 tst assert_extension.py: using LAC 25941 04:19:12.780877 tst assert_extension.py: using RAC 186 04:19:12.899205 tst assert_extension.py: using CellId 25941 04:19:13.018774 tst assert_extension.py: using BVCI 25942 04:19:13.130804 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 04:19:13.241162 tst assert_extension.py:10: start nitb and bts... 04:19:13.435222 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:19:14.023996 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25463): Launched 04:19:14.310527 run osmo-nitb_10.42.42.2(pid=25464): Launched 04:19:14.469573 run osmo-nitb_10.42.42.2(pid=25464): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25464)] 04:19:14.598608 run osmo-nitb_10.42.42.2(pid=25464): stdout: | (launched: 2022-12-10_04:19:14.258429) 04:19:14.731059 run osmo-nitb_10.42.42.2(pid=25464): stderr: | (launched: 2022-12-10_04:19:14.301166) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:19:14.862136 run osmo-nitb_10.42.42.2(pid=25464): stdout: | (launched: 2022-12-10_04:19:14.258429) 04:19:14.987465 run osmo-nitb_10.42.42.2(pid=25464): stderr: | (launched: 2022-12-10_04:19:14.301166) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25464): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25464) [trial-2369↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25464)] 04:19:15.419154 tst osmo-nitb_10.42.42.2(pid=25464): stdout: | (launched: 2022-12-10_04:19:14.258429) 04:19:15.536161 tst osmo-nitb_10.42.42.2(pid=25464): stderr: | (launched: 2022-12-10_04:19:14.301166) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:19:15.673282 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25464): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25464) [trial-2369↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25464)] [trial-2369↪nitb_ussd:trx-lms↪assert_extension.py:12] 04:19:15.681956 tst assert_extension.py:12: Test FAILED (3.1 sec) 04:19:15.688422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25463): Terminating (SIGTERM) 04:19:15.896629 --- ParallelTerminationStrategy: PID 25463 died... 04:19:15.915427 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25463): Terminated: ok {rc=0} 04:19:16.020902 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:trx-lms --------------------------------------------------------------------- 04:19:17.213642 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:17.217809 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 04:19:17.255037 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:19:17.281927 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 04:19:17.316157 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 04:19:17.350048 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:19:17.377496 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 04:19:17.907071 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:trx-lms assert_extension.py ---------------------------------------------- 04:19:17.912501 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:17.923578 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 04:19:17.972331 tst assert_extension.py: using LAC 25942 04:19:18.090330 tst assert_extension.py: using RAC 187 04:19:18.211953 tst assert_extension.py: using CellId 25942 04:19:18.330198 tst assert_extension.py: using BVCI 25943 04:19:18.442343 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:18.453251 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:18.463965 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:18.474892 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:18.485951 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:18.496800 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 04:19:18.607371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:19.051314 run create_hlr_db(pid=25468): Launched 04:19:19.160519 bus /sierra_2: Setting Powered False 04:19:20.221986 run create_hlr_db(pid=25468): Terminated: ok {rc=0} 04:19:20.648464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25470): Launched 04:19:20.953540 run osmo-hlr_10.42.42.2(pid=25471): Launched 04:19:21.070279 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:21.597483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25473): Launched 04:19:21.902437 run osmo-stp_10.42.42.5(pid=25474): Launched 04:19:22.019835 run osmo-msc_10.42.42.6: Starting osmo-msc 04:19:22.572102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25476): Launched 04:19:22.876610 run osmo-msc_10.42.42.6(pid=25477): Launched 04:19:23.047781 run osmo-stp_10.42.42.5(pid=25474): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25474)] 04:19:23.177915 run osmo-stp_10.42.42.5(pid=25474): stdout: | (launched: 2022-12-10_04:19:21.846962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:23.308555 run osmo-stp_10.42.42.5(pid=25474): stderr: | 20221210041922035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041922035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041922036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041922036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041922036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041922037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041922037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:23.438725 run osmo-stp_10.42.42.5(pid=25474): stdout: | (launched: 2022-12-10_04:19:21.846962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:23.561650 run osmo-stp_10.42.42.5(pid=25474): stderr: | 20221210041922035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041922035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041922036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041922036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041922036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041922037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041922037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:23.707891 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25474): Process ended prematurely: osmo-stp_10.42.42.5(pid=25474) [trial-2369↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25474)] [trial-2369↪ussd:trx-lms↪assert_extension.py:17] 04:19:23.717045 tst assert_extension.py:17: Test FAILED (5.8 sec) 04:19:23.744515 run osmo-hlr_10.42.42.2(pid=25471): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25471)] 04:19:23.794027 run osmo-hlr_10.42.42.2(pid=25471): stdout: | (launched: 2022-12-10_04:19:20.898027) 04:19:23.845292 run osmo-hlr_10.42.42.2(pid=25471): stderr: | 20221210041921094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041921094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041921094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041921094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041921094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041921095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041921107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041921118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041921118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041921118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:23.916560 run osmo-msc_10.42.42.6(pid=25477): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25477)] 04:19:23.966372 run osmo-msc_10.42.42.6(pid=25477): stdout: | (launched: 2022-12-10_04:19:22.821389) 04:19:24.017571 run osmo-msc_10.42.42.6(pid=25477): stderr: | 20221210041923139 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041923139 DLGLOBAL DEBUG validating counter group 0x7f664660dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041923139 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041923139 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041923139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041923139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041923141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041923142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041923142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041923142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:19:24.069142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25470): Terminating (SIGTERM) 04:19:24.110394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25473): Terminating (SIGTERM) 04:19:24.151589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25476): Terminating (SIGTERM) 04:19:24.193083 --- ParallelTerminationStrategy: PID 25470 died... 04:19:24.212815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25470): Terminated: ok {rc=0} 04:19:24.258520 --- ParallelTerminationStrategy: PID 25473 died... 04:19:24.277924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25473): Terminated: ok {rc=0} 04:19:24.323557 --- ParallelTerminationStrategy: PID 25476 died... 04:19:24.343123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25476): Terminated: ok {rc=0} 04:19:24.429289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:19:25.637704 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:25.644205 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:19:25.679156 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:19:25.706239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:19:25.758718 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:19:25.793122 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:19:25.820619 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:19:26.368062 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:19:26.420561 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:26.432369 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:19:26.503652 tst mo_mt_call.py: using LAC 25943 04:19:26.628925 tst mo_mt_call.py: using RAC 188 04:19:26.750779 tst mo_mt_call.py: using CellId 25943 04:19:26.872642 tst mo_mt_call.py: using BVCI 25944 04:19:26.985514 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:26.997065 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:27.008234 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:27.019731 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:27.031315 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:27.042777 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:19:27.153872 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:19:27.273373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:27.755741 run create_hlr_db(pid=25482): Launched 04:19:27.882541 bus /sierra_2: Setting Powered False 04:19:28.945422 run create_hlr_db(pid=25482): Terminated: ok {rc=0} 04:19:29.363603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25484): Launched 04:19:29.655264 run osmo-hlr_10.42.42.2(pid=25485): Launched 04:19:29.766957 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:30.280864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25487): Launched 04:19:30.572212 run osmo-stp_10.42.42.5(pid=25488): Launched 04:19:30.683155 run osmo-msc_10.42.42.6: Starting osmo-msc 04:19:31.253739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25490): Launched 04:19:31.563082 run osmo-msc_10.42.42.6(pid=25491): Launched 04:19:32.023580 run osmo-stp_10.42.42.5(pid=25488): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25488)] 04:19:32.313156 run osmo-stp_10.42.42.5(pid=25488): stdout: | (launched: 2022-12-10_04:19:30.519285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:32.445369 run osmo-stp_10.42.42.5(pid=25488): stderr: | 20221210041930687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041930687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041930688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041930688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041930690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041930690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041930690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:32.576401 run osmo-stp_10.42.42.5(pid=25488): stdout: | (launched: 2022-12-10_04:19:30.519285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:32.701068 run osmo-stp_10.42.42.5(pid=25488): stderr: | 20221210041930687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041930687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041930688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041930688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041930690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041930690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041930690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:32.849408 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25488): Process ended prematurely: osmo-stp_10.42.42.5(pid=25488) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25488)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:19:32.859337 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:19:32.887475 run osmo-hlr_10.42.42.2(pid=25485): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25485)] 04:19:32.937430 run osmo-hlr_10.42.42.2(pid=25485): stdout: | (launched: 2022-12-10_04:19:29.601967) 04:19:32.989046 run osmo-hlr_10.42.42.2(pid=25485): stderr: | 20221210041929775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041929775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041929775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041929775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041929775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041929775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041929787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041929796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041929796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041929796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:33.060164 run osmo-msc_10.42.42.6(pid=25491): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25491)] 04:19:33.109627 run osmo-msc_10.42.42.6(pid=25491): stdout: | (launched: 2022-12-10_04:19:31.504426) 04:19:33.160616 run osmo-msc_10.42.42.6(pid=25491): stderr: | 20221210041931875 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041931875 DLGLOBAL DEBUG validating counter group 0x7f39eba2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041931875 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041931875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041931875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041931875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041931877 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041931878 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041931878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041931878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:19:33.212084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25484): Terminating (SIGTERM) 04:19:33.253411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25487): Terminating (SIGTERM) 04:19:33.295019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25490): Terminating (SIGTERM) 04:19:33.337034 --- ParallelTerminationStrategy: PID 25484 died... 04:19:33.356874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25484): Terminated: ok {rc=0} 04:19:33.403058 --- ParallelTerminationStrategy: PID 25487 died... 04:19:33.422644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25487): Terminated: ok {rc=0} 04:19:33.468621 --- ParallelTerminationStrategy: PID 25490 died... 04:19:33.488345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25490): Terminated: ok {rc=0} 04:19:33.575759 bus /sierra_3: Setting Powered False 04:19:34.673108 bus /sierra_3: Setting Powered False 04:19:35.789146 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:19:36.932263 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:36.944029 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:19:37.013388 tst mo_mt_call_osmux.py: using LAC 25944 04:19:37.129748 tst mo_mt_call_osmux.py: using RAC 189 04:19:37.245615 tst mo_mt_call_osmux.py: using CellId 25944 04:19:37.359964 tst mo_mt_call_osmux.py: using BVCI 25945 04:19:37.465343 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:37.476337 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:37.487230 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:37.498309 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:37.509533 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:19:37.520162 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:19:37.633345 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:19:37.754108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:38.235104 run create_hlr_db(pid=25493): Launched 04:19:38.361747 bus /sierra_2: Setting Powered False 04:19:39.423781 run create_hlr_db(pid=25493): Terminated: ok {rc=0} 04:19:39.855686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25495): Launched 04:19:40.166068 run osmo-hlr_10.42.42.2(pid=25496): Launched 04:19:40.285842 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:40.824520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25498): Launched 04:19:41.134610 run osmo-stp_10.42.42.5(pid=25499): Launched 04:19:41.251974 run osmo-msc_10.42.42.6: Starting osmo-msc 04:19:41.813150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25501): Launched 04:19:42.123361 run osmo-msc_10.42.42.6(pid=25502): Launched 04:19:42.295775 run osmo-stp_10.42.42.5(pid=25499): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25499)] 04:19:42.430821 run osmo-stp_10.42.42.5(pid=25499): stdout: | (launched: 2022-12-10_04:19:41.078473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:42.562111 run osmo-stp_10.42.42.5(pid=25499): stderr: | 20221210041941269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041941269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041941269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041941270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041941272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041941272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041941272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:42.690850 run osmo-stp_10.42.42.5(pid=25499): stdout: | (launched: 2022-12-10_04:19:41.078473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:42.814188 run osmo-stp_10.42.42.5(pid=25499): stderr: | 20221210041941269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041941269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041941269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041941270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041941272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041941272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041941272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:42.962331 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25499): Process ended prematurely: osmo-stp_10.42.42.5(pid=25499) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25499)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:19:42.972103 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:19:42.999930 run osmo-hlr_10.42.42.2(pid=25496): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25496)] 04:19:43.049219 run osmo-hlr_10.42.42.2(pid=25496): stdout: | (launched: 2022-12-10_04:19:40.110271) 04:19:43.100098 run osmo-hlr_10.42.42.2(pid=25496): stderr: | 20221210041940308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041940308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041940308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041940308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041940308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041940308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041940321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041940329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041940329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041940329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:43.170901 run osmo-msc_10.42.42.6(pid=25502): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25502)] 04:19:43.219990 run osmo-msc_10.42.42.6(pid=25502): stdout: | (launched: 2022-12-10_04:19:42.067031) 04:19:43.270624 run osmo-msc_10.42.42.6(pid=25502): stderr: | 20221210041942386 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041942386 DLGLOBAL DEBUG validating counter group 0x7f368e463c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041942386 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041942386 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041942386 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041942387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041942388 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041942389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041942389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041942389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:19:43.321623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25495): Terminating (SIGTERM) 04:19:43.362521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25498): Terminating (SIGTERM) 04:19:43.403650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25501): Terminating (SIGTERM) 04:19:43.444740 --- ParallelTerminationStrategy: PID 25495 died... 04:19:43.464428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25495): Terminated: ok {rc=0} 04:19:43.509874 --- ParallelTerminationStrategy: PID 25498 died... 04:19:43.529184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25498): Terminated: ok {rc=0} 04:19:43.574346 --- ParallelTerminationStrategy: PID 25501 died... 04:19:43.593672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25501): Terminated: ok {rc=0} 04:19:43.679463 bus /sierra_3: Setting Powered False 04:19:44.774798 bus /sierra_3: Setting Powered False 04:19:45.906283 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:19:47.163562 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:47.171182 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:19:47.206299 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:19:47.234273 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:19:47.288411 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:19:47.322464 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:19:47.349696 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:19:47.901408 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:19:47.951550 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:47.963105 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:19:48.034039 tst mo_mt_call.py: using LAC 25945 04:19:48.156694 tst mo_mt_call.py: using RAC 190 04:19:48.278624 tst mo_mt_call.py: using CellId 25945 04:19:48.401736 tst mo_mt_call.py: using BVCI 25946 04:19:48.516623 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:48.528258 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:48.539764 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:48.551127 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:48.562612 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:48.573974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:19:48.687519 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:19:48.803258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:49.285245 run create_hlr_db(pid=25507): Launched 04:19:49.411703 bus /sierra_2: Setting Powered False 04:19:50.474911 run create_hlr_db(pid=25507): Terminated: ok {rc=0} 04:19:50.908552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25509): Launched 04:19:51.220630 run osmo-hlr_10.42.42.2(pid=25510): Launched 04:19:51.338679 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:51.879743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25512): Launched 04:19:52.190796 run osmo-stp_10.42.42.5(pid=25513): Launched 04:19:52.308701 run osmo-msc_10.42.42.6: Starting osmo-msc 04:19:52.871565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25515): Launched 04:19:53.183030 run osmo-msc_10.42.42.6(pid=25516): Launched 04:19:53.355804 run osmo-stp_10.42.42.5(pid=25513): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25513)] 04:19:53.487160 run osmo-stp_10.42.42.5(pid=25513): stdout: | (launched: 2022-12-10_04:19:52.134608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:53.618973 run osmo-stp_10.42.42.5(pid=25513): stderr: | 20221210041952326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041952327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041952327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041952327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041952328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041952328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041952328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:53.750065 run osmo-stp_10.42.42.5(pid=25513): stdout: | (launched: 2022-12-10_04:19:52.134608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:53.873735 run osmo-stp_10.42.42.5(pid=25513): stderr: | 20221210041952326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210041952327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210041952327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210041952327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210041952328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210041952328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210041952328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:54.022647 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25513): Process ended prematurely: osmo-stp_10.42.42.5(pid=25513) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25513)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:19:54.032367 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:19:54.059928 run osmo-hlr_10.42.42.2(pid=25510): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25510)] 04:19:54.109339 run osmo-hlr_10.42.42.2(pid=25510): stdout: | (launched: 2022-12-10_04:19:51.163585) 04:19:54.160443 run osmo-hlr_10.42.42.2(pid=25510): stderr: | 20221210041951362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210041951362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210041951363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210041951363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210041951363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210041951363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210041951375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210041951386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210041951387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210041951387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:54.231366 run osmo-msc_10.42.42.6(pid=25516): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25516)] 04:19:54.281060 run osmo-msc_10.42.42.6(pid=25516): stdout: | (launched: 2022-12-10_04:19:53.126533) 04:19:54.331773 run osmo-msc_10.42.42.6(pid=25516): stderr: | 20221210041953446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210041953446 DLGLOBAL DEBUG validating counter group 0x7fcd0f132c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210041953446 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210041953446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210041953446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210041953447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210041953448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210041953449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210041953449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210041953449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:19:54.382961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25509): Terminating (SIGTERM) 04:19:54.424400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25512): Terminating (SIGTERM) 04:19:54.465706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25515): Terminating (SIGTERM) 04:19:54.507118 --- ParallelTerminationStrategy: PID 25509 died... 04:19:54.526502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25509): Terminated: ok {rc=0} 04:19:54.572662 --- ParallelTerminationStrategy: PID 25512 died... 04:19:54.592097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25512): Terminated: ok {rc=0} 04:19:54.637788 --- ParallelTerminationStrategy: PID 25515 died... 04:19:54.657071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25515): Terminated: ok {rc=0} 04:19:54.745254 bus /sierra_3: Setting Powered False 04:19:55.843102 bus /sierra_3: Setting Powered False 04:19:56.957143 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:19:58.104080 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:58.116156 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:19:58.186897 tst mo_mt_call_osmux.py: using LAC 25946 04:19:58.308641 tst mo_mt_call_osmux.py: using RAC 191 04:19:58.429733 tst mo_mt_call_osmux.py: using CellId 25946 04:19:58.551347 tst mo_mt_call_osmux.py: using BVCI 25947 04:19:58.664365 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:58.675856 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:58.687487 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:58.698839 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:58.710213 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:19:58.721494 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:19:58.837196 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:19:58.950392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:59.404495 run create_hlr_db(pid=25518): Launched 04:19:59.516843 bus /sierra_2: Setting Powered False 04:20:00.575651 run create_hlr_db(pid=25518): Terminated: ok {rc=0} 04:20:01.037747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25520): Launched 04:20:01.389101 run osmo-hlr_10.42.42.2(pid=25522): Launched 04:20:01.659117 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:02.317838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25526): Launched 04:20:02.648019 run osmo-stp_10.42.42.5(pid=25527): Launched 04:20:02.759787 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:03.289922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25529): Launched 04:20:03.581081 run osmo-msc_10.42.42.6(pid=25530): Launched 04:20:03.744658 run osmo-stp_10.42.42.5(pid=25527): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25527)] 04:20:03.869323 run osmo-stp_10.42.42.5(pid=25527): stdout: | (launched: 2022-12-10_04:20:02.594121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:03.994216 run osmo-stp_10.42.42.5(pid=25527): stderr: | 20221210042002763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042002764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042002764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042002764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042002765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042002765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042002765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:04.116217 run osmo-stp_10.42.42.5(pid=25527): stdout: | (launched: 2022-12-10_04:20:02.594121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:04.232221 run osmo-stp_10.42.42.5(pid=25527): stderr: | 20221210042002763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042002764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042002764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042002764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042002765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042002765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042002765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:04.371679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25527): Process ended prematurely: osmo-stp_10.42.42.5(pid=25527) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25527)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:20:04.380684 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:20:04.407497 run osmo-hlr_10.42.42.2(pid=25522): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25522)] 04:20:04.454663 run osmo-hlr_10.42.42.2(pid=25522): stdout: | (launched: 2022-12-10_04:20:01.321872) 04:20:04.503368 run osmo-hlr_10.42.42.2(pid=25522): stderr: | 20221210042001569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042001569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042001569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042001569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042001569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042001569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042001582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042001604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042001604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042001604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:04.571583 run osmo-msc_10.42.42.6(pid=25530): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25530)] 04:20:04.618866 run osmo-msc_10.42.42.6(pid=25530): stdout: | (launched: 2022-12-10_04:20:03.527889) 04:20:04.667685 run osmo-msc_10.42.42.6(pid=25530): stderr: | 20221210042003798 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042003798 DLGLOBAL DEBUG validating counter group 0x7fdd9352cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042003798 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042003798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042003798 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042003798 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042003800 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042003800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042003800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042003801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:04.717092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25520): Terminating (SIGTERM) 04:20:04.756440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25526): Terminating (SIGTERM) 04:20:04.795794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25529): Terminating (SIGTERM) 04:20:04.835663 --- ParallelTerminationStrategy: PID 25520 died... 04:20:04.854483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25520): Terminated: ok {rc=0} 04:20:04.898131 --- ParallelTerminationStrategy: PID 25526 died... 04:20:04.916427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25526): Terminated: ok {rc=0} 04:20:04.960007 --- ParallelTerminationStrategy: PID 25529 died... 04:20:04.978270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25529): Terminated: ok {rc=0} 04:20:05.063391 bus /sierra_3: Setting Powered False 04:20:06.161238 bus /sierra_3: Setting Powered False 04:20:07.276899 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:20:08.522157 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:08.528405 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:20:08.561385 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:20:08.587719 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:20:08.638916 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:20:08.671717 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:20:08.698286 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:20:09.246835 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:20:09.293682 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:09.304857 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:20:09.373308 tst mo_mt_call.py: using LAC 25947 04:20:09.489682 tst mo_mt_call.py: using RAC 192 04:20:09.604029 tst mo_mt_call.py: using CellId 25947 04:20:09.719678 tst mo_mt_call.py: using BVCI 25948 04:20:09.824640 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:09.835724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:09.846553 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:09.857594 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:09.868633 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:09.879639 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:20:09.994459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:20:10.111542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:10.562565 run create_hlr_db(pid=25535): Launched 04:20:10.673148 bus /sierra_2: Setting Powered False 04:20:11.732167 run create_hlr_db(pid=25535): Terminated: ok {rc=0} 04:20:12.140097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25537): Launched 04:20:12.431892 run osmo-hlr_10.42.42.2(pid=25538): Launched 04:20:12.544406 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:13.060405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25540): Launched 04:20:13.351684 run osmo-stp_10.42.42.5(pid=25541): Launched 04:20:13.462627 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:13.989307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25543): Launched 04:20:14.281424 run osmo-msc_10.42.42.6(pid=25544): Launched 04:20:14.444584 run osmo-stp_10.42.42.5(pid=25541): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25541)] 04:20:14.568344 run osmo-stp_10.42.42.5(pid=25541): stdout: | (launched: 2022-12-10_04:20:13.298879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:14.692194 run osmo-stp_10.42.42.5(pid=25541): stderr: | 20221210042013465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042013465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042013465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042013466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042013468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042013468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042013468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:14.813734 run osmo-stp_10.42.42.5(pid=25541): stdout: | (launched: 2022-12-10_04:20:13.298879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:14.929783 run osmo-stp_10.42.42.5(pid=25541): stderr: | 20221210042013465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042013465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042013465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042013466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042013468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042013468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042013468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:15.068493 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25541): Process ended prematurely: osmo-stp_10.42.42.5(pid=25541) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25541)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:20:15.077372 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 04:20:15.103588 run osmo-hlr_10.42.42.2(pid=25538): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25538)] 04:20:15.150952 run osmo-hlr_10.42.42.2(pid=25538): stdout: | (launched: 2022-12-10_04:20:12.378674) 04:20:15.199757 run osmo-hlr_10.42.42.2(pid=25538): stderr: | 20221210042012554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042012554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042012554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042012554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042012554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042012554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042012567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042012577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042012577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042012577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:15.267318 run osmo-msc_10.42.42.6(pid=25544): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25544)] 04:20:15.313980 run osmo-msc_10.42.42.6(pid=25544): stdout: | (launched: 2022-12-10_04:20:14.227226) 04:20:15.362376 run osmo-msc_10.42.42.6(pid=25544): stderr: | 20221210042014497 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042014497 DLGLOBAL DEBUG validating counter group 0x7fefa29b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042014497 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042014497 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042014498 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042014498 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042014499 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042014500 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042014500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042014500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:15.411291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25537): Terminating (SIGTERM) 04:20:15.450184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25540): Terminating (SIGTERM) 04:20:15.489330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25543): Terminating (SIGTERM) 04:20:15.529134 --- ParallelTerminationStrategy: PID 25537 died... 04:20:15.547619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25537): Terminated: ok {rc=0} 04:20:15.591096 --- ParallelTerminationStrategy: PID 25540 died... 04:20:15.609146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25540): Terminated: ok {rc=0} 04:20:15.653005 --- ParallelTerminationStrategy: PID 25543 died... 04:20:15.671165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25543): Terminated: ok {rc=0} 04:20:15.756548 bus /sierra_3: Setting Powered False 04:20:16.857985 bus /sierra_3: Setting Powered False 04:20:17.977486 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:20:19.127036 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:19.139073 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:20:19.214008 tst mo_mt_call_osmux.py: using LAC 25948 04:20:19.335833 tst mo_mt_call_osmux.py: using RAC 193 04:20:19.456586 tst mo_mt_call_osmux.py: using CellId 25948 04:20:19.577391 tst mo_mt_call_osmux.py: using BVCI 25949 04:20:19.689989 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:19.701711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:19.713166 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:19.724489 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:19.735933 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:19.747296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:20:19.859832 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:20:19.973770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:20.427644 run create_hlr_db(pid=25546): Launched 04:20:20.540105 bus /sierra_2: Setting Powered False 04:20:21.600068 run create_hlr_db(pid=25546): Terminated: ok {rc=0} 04:20:22.028089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25548): Launched 04:20:22.339937 run osmo-hlr_10.42.42.2(pid=25549): Launched 04:20:22.459002 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:22.996925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25552): Launched 04:20:23.307346 run osmo-stp_10.42.42.5(pid=25553): Launched 04:20:23.425502 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:23.989722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25555): Launched 04:20:24.300279 run osmo-msc_10.42.42.6(pid=25556): Launched 04:20:24.473733 run osmo-stp_10.42.42.5(pid=25553): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25553)] 04:20:24.605654 run osmo-stp_10.42.42.5(pid=25553): stdout: | (launched: 2022-12-10_04:20:23.251293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:24.737134 run osmo-stp_10.42.42.5(pid=25553): stderr: | 20221210042023442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042023442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042023443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042023443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042023444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042023444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042023444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:24.869056 run osmo-stp_10.42.42.5(pid=25553): stdout: | (launched: 2022-12-10_04:20:23.251293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:24.993500 run osmo-stp_10.42.42.5(pid=25553): stderr: | 20221210042023442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042023442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042023443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042023443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042023444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042023444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042023444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:25.142374 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25553): Process ended prematurely: osmo-stp_10.42.42.5(pid=25553) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25553)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:20:25.152020 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:20:25.179929 run osmo-hlr_10.42.42.2(pid=25549): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25549)] 04:20:25.229606 run osmo-hlr_10.42.42.2(pid=25549): stdout: | (launched: 2022-12-10_04:20:22.283281) 04:20:25.281101 run osmo-hlr_10.42.42.2(pid=25549): stderr: | 20221210042022479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042022479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042022479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042022479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042022479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042022479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042022493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042022503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042022503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042022503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:25.352760 run osmo-msc_10.42.42.6(pid=25556): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25556)] 04:20:25.402353 run osmo-msc_10.42.42.6(pid=25556): stdout: | (launched: 2022-12-10_04:20:24.243935) 04:20:25.453426 run osmo-msc_10.42.42.6(pid=25556): stderr: | 20221210042024564 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042024565 DLGLOBAL DEBUG validating counter group 0x7f2e19fb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042024565 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042024565 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042024565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042024565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042024567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042024567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042024567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042024567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:25.505014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25548): Terminating (SIGTERM) 04:20:25.546332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25552): Terminating (SIGTERM) 04:20:25.587858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25555): Terminating (SIGTERM) 04:20:25.629517 --- ParallelTerminationStrategy: PID 25548 died... 04:20:25.649367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25548): Terminated: ok {rc=0} 04:20:25.695084 --- ParallelTerminationStrategy: PID 25552 died... 04:20:25.714318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25552): Terminated: ok {rc=0} 04:20:25.760257 --- ParallelTerminationStrategy: PID 25555 died... 04:20:25.779733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25555): Terminated: ok {rc=0} 04:20:25.865539 bus /sierra_3: Setting Powered False 04:20:26.963429 bus /sierra_3: Setting Powered False 04:20:28.079161 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:20:29.328608 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:29.335143 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:20:29.368475 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:20:29.394964 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:20:29.450124 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:20:29.483439 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:20:29.509861 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:20:30.057520 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:20:30.104837 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:30.115989 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:20:30.183726 tst mo_mt_call.py: using LAC 25949 04:20:30.298357 tst mo_mt_call.py: using RAC 194 04:20:30.411022 tst mo_mt_call.py: using CellId 25949 04:20:30.524029 tst mo_mt_call.py: using BVCI 25950 04:20:30.630037 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:30.640892 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:30.651642 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:30.662739 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:30.674270 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:30.685329 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:20:30.797336 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:20:30.934940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:31.448862 run create_hlr_db(pid=25561): Launched 04:20:31.610956 bus /sierra_2: Setting Powered False 04:20:32.673307 run create_hlr_db(pid=25561): Terminated: ok {rc=0} 04:20:33.109023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Launched 04:20:33.420404 run osmo-hlr_10.42.42.2(pid=25564): Launched 04:20:33.538825 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:34.072659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Launched 04:20:34.382687 run osmo-stp_10.42.42.5(pid=25567): Launched 04:20:34.501202 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:35.065783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Launched 04:20:35.376849 run osmo-msc_10.42.42.6(pid=25570): Launched 04:20:35.550595 run osmo-stp_10.42.42.5(pid=25567): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] 04:20:35.684230 run osmo-stp_10.42.42.5(pid=25567): stdout: | (launched: 2022-12-10_04:20:34.326329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:35.815307 run osmo-stp_10.42.42.5(pid=25567): stderr: | 20221210042034518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042034518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042034518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042034519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042034519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042034519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042034519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:35.945404 run osmo-stp_10.42.42.5(pid=25567): stdout: | (launched: 2022-12-10_04:20:34.326329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:36.070270 run osmo-stp_10.42.42.5(pid=25567): stderr: | 20221210042034518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042034518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042034518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042034519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042034519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042034519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042034519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:36.219000 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25567): Process ended prematurely: osmo-stp_10.42.42.5(pid=25567) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:20:36.228801 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:20:36.257083 run osmo-hlr_10.42.42.2(pid=25564): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25564)] 04:20:36.306773 run osmo-hlr_10.42.42.2(pid=25564): stdout: | (launched: 2022-12-10_04:20:33.364148) 04:20:36.358343 run osmo-hlr_10.42.42.2(pid=25564): stderr: | 20221210042033561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042033561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042033561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042033561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042033561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042033562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042033574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042033582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042033583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042033583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:36.429789 run osmo-msc_10.42.42.6(pid=25570): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25570)] 04:20:36.479580 run osmo-msc_10.42.42.6(pid=25570): stdout: | (launched: 2022-12-10_04:20:35.320569) 04:20:36.530941 run osmo-msc_10.42.42.6(pid=25570): stderr: | 20221210042035642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042035642 DLGLOBAL DEBUG validating counter group 0x7f073e950c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042035642 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042035642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042035643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042035643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042035644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042035645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042035645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042035645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:36.582909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Terminating (SIGTERM) 04:20:36.624420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Terminating (SIGTERM) 04:20:36.666086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Terminating (SIGTERM) 04:20:36.708019 --- ParallelTerminationStrategy: PID 25563 died... 04:20:36.727791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25563): Terminated: ok {rc=0} 04:20:36.773694 --- ParallelTerminationStrategy: PID 25566 died... 04:20:36.793092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25566): Terminated: ok {rc=0} 04:20:36.838814 --- ParallelTerminationStrategy: PID 25569 died... 04:20:36.858500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25569): Terminated: ok {rc=0} 04:20:36.945511 bus /sierra_3: Setting Powered False 04:20:38.044147 bus /sierra_3: Setting Powered False 04:20:39.160073 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:20:40.304493 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:40.316648 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:20:40.386250 tst mo_mt_call_osmux.py: using LAC 25950 04:20:40.503070 tst mo_mt_call_osmux.py: using RAC 195 04:20:40.621095 tst mo_mt_call_osmux.py: using CellId 25950 04:20:40.744805 tst mo_mt_call_osmux.py: using BVCI 25951 04:20:40.859566 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:40.871323 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:40.882872 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:40.894434 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:40.906229 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:20:40.918166 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:20:41.031949 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:20:41.144601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:41.597175 run create_hlr_db(pid=25572): Launched 04:20:41.710163 bus /sierra_2: Setting Powered False 04:20:42.769302 run create_hlr_db(pid=25572): Terminated: ok {rc=0} 04:20:43.199109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Launched 04:20:43.511350 run osmo-hlr_10.42.42.2(pid=25575): Launched 04:20:43.631332 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:44.169814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Launched 04:20:44.482934 run osmo-stp_10.42.42.5(pid=25578): Launched 04:20:44.603012 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:45.169619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Launched 04:20:45.482866 run osmo-msc_10.42.42.6(pid=25581): Launched 04:20:45.658661 run osmo-stp_10.42.42.5(pid=25578): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] 04:20:45.790898 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-10_04:20:44.425574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:46.050259 run osmo-stp_10.42.42.5(pid=25578): stderr: | 20221210042044617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042044618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042044618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042044618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042044619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042044619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042044619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:46.183408 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-10_04:20:44.425574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:46.305759 run osmo-stp_10.42.42.5(pid=25578): stderr: | 20221210042044617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042044618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042044618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042044618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042044619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042044619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042044619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:46.453643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:20:46.463644 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:20:46.494389 run osmo-hlr_10.42.42.2(pid=25575): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25575)] 04:20:46.544833 run osmo-hlr_10.42.42.2(pid=25575): stdout: | (launched: 2022-12-10_04:20:43.454947) 04:20:46.596866 run osmo-hlr_10.42.42.2(pid=25575): stderr: | 20221210042043652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042043652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042043652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042043652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042043652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042043652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042043667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042043677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042043678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042043678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:46.669805 run osmo-msc_10.42.42.6(pid=25581): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25581)] 04:20:46.721721 run osmo-msc_10.42.42.6(pid=25581): stdout: | (launched: 2022-12-10_04:20:45.425401) 04:20:46.773686 run osmo-msc_10.42.42.6(pid=25581): stderr: | 20221210042045744 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042045745 DLGLOBAL DEBUG validating counter group 0x7f3fe28e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042045745 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042045745 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042045745 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042045745 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042045747 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042045747 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042045747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042045747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:46.826556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminating (SIGTERM) 04:20:46.869567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminating (SIGTERM) 04:20:46.915195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Terminating (SIGTERM) 04:20:46.960526 --- ParallelTerminationStrategy: PID 25574 died... 04:20:46.980813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminated: ok {rc=0} 04:20:47.030645 --- ParallelTerminationStrategy: PID 25577 died... 04:20:47.050605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminated: ok {rc=0} 04:20:47.099290 --- ParallelTerminationStrategy: PID 25580 died... 04:20:47.118912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Terminated: ok {rc=0} 04:20:47.207525 bus /sierra_3: Setting Powered False 04:20:48.308804 bus /sierra_3: Setting Powered False 04:20:49.424773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:20:50.677496 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:50.684405 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:20:50.718199 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:20:50.745242 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:20:50.797543 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:20:50.831306 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:20:50.858112 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:20:51.409642 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:20:51.460145 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:20:51.471724 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:20:51.542548 tst mo_mt_call.py: using LAC 25951 04:20:51.666449 tst mo_mt_call.py: using RAC 196 04:20:51.788382 tst mo_mt_call.py: using CellId 25951 04:20:51.911334 tst mo_mt_call.py: using BVCI 25952 04:20:52.020562 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:20:52.031727 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:20:52.042790 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:20:52.054278 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:20:52.065854 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:20:52.077319 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:20:52.193706 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:20:52.309835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:52.790740 run create_hlr_db(pid=25586): Launched 04:20:52.908666 bus /sierra_2: Setting Powered False 04:20:53.967618 run create_hlr_db(pid=25586): Terminated: ok {rc=0} 04:20:54.374806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Launched 04:20:54.666511 run osmo-hlr_10.42.42.2(pid=25589): Launched 04:20:54.777643 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:55.280192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Launched 04:20:55.571792 run osmo-stp_10.42.42.5(pid=25592): Launched 04:20:55.682652 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:56.209755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Launched 04:20:56.501192 run osmo-msc_10.42.42.6(pid=25595): Launched 04:20:56.664297 run osmo-stp_10.42.42.5(pid=25592): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] 04:20:56.788390 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-10_04:20:55.518517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:56.913329 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221210042055687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042055687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042055687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042055688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042055688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042055688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042055688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:57.035666 run osmo-stp_10.42.42.5(pid=25592): stdout: | (launched: 2022-12-10_04:20:55.518517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:57.152346 run osmo-stp_10.42.42.5(pid=25592): stderr: | 20221210042055687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042055687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042055687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042055688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042055688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042055688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042055688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:57.291746 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:20:57.300696 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 04:20:57.327195 run osmo-hlr_10.42.42.2(pid=25589): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25589)] 04:20:57.374360 run osmo-hlr_10.42.42.2(pid=25589): stdout: | (launched: 2022-12-10_04:20:54.613337) 04:20:57.423324 run osmo-hlr_10.42.42.2(pid=25589): stderr: | 20221210042054788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042054788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042054788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042054789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042054789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042054789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042054801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042054809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042054810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042054810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:57.491239 run osmo-msc_10.42.42.6(pid=25595): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25595)] 04:20:57.538368 run osmo-msc_10.42.42.6(pid=25595): stdout: | (launched: 2022-12-10_04:20:56.448065) 04:20:57.587197 run osmo-msc_10.42.42.6(pid=25595): stderr: | 20221210042056718 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042056718 DLGLOBAL DEBUG validating counter group 0x7fa71804cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042056718 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042056718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042056718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042056719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042056720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042056721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042056721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042056721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:57.636576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminating (SIGTERM) 04:20:57.675904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminating (SIGTERM) 04:20:57.715456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Terminating (SIGTERM) 04:20:57.755497 --- ParallelTerminationStrategy: PID 25588 died... 04:20:57.774747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25588): Terminated: ok {rc=0} 04:20:57.818747 --- ParallelTerminationStrategy: PID 25591 died... 04:20:57.837076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25591): Terminated: ok {rc=0} 04:20:57.880448 --- ParallelTerminationStrategy: PID 25594 died... 04:20:57.898620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25594): Terminated: ok {rc=0} 04:20:57.980917 bus /sierra_3: Setting Powered False 04:20:59.078425 bus /sierra_3: Setting Powered False 04:21:00.192135 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:21:01.338008 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:01.350590 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:21:01.422606 tst mo_mt_call_osmux.py: using LAC 25952 04:21:01.542037 tst mo_mt_call_osmux.py: using RAC 197 04:21:01.659858 tst mo_mt_call_osmux.py: using CellId 25952 04:21:01.778848 tst mo_mt_call_osmux.py: using BVCI 25953 04:21:01.889602 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:01.901605 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:01.913468 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:01.926181 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:01.938792 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:01.952540 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:02.067018 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:02.181434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:02.645703 run create_hlr_db(pid=25597): Launched 04:21:02.758022 bus /sierra_2: Setting Powered False 04:21:03.815817 run create_hlr_db(pid=25597): Terminated: ok {rc=0} 04:21:04.244928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25599): Launched 04:21:04.556356 run osmo-hlr_10.42.42.2(pid=25600): Launched 04:21:04.675467 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:05.213438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25602): Launched 04:21:05.523011 run osmo-stp_10.42.42.5(pid=25603): Launched 04:21:05.642410 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:06.204409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25605): Launched 04:21:06.514381 run osmo-msc_10.42.42.6(pid=25606): Launched 04:21:06.688134 run osmo-stp_10.42.42.5(pid=25603): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25603)] 04:21:06.819692 run osmo-stp_10.42.42.5(pid=25603): stdout: | (launched: 2022-12-10_04:21:05.466985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:06.952008 run osmo-stp_10.42.42.5(pid=25603): stderr: | 20221210042105654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042105654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042105654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042105655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042105657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042105657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042105657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:07.083723 run osmo-stp_10.42.42.5(pid=25603): stdout: | (launched: 2022-12-10_04:21:05.466985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:07.208165 run osmo-stp_10.42.42.5(pid=25603): stderr: | 20221210042105654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042105654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042105654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042105655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042105657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042105657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042105657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:07.356747 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25603): Process ended prematurely: osmo-stp_10.42.42.5(pid=25603) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25603)] [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:21:07.366664 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:21:07.394310 run osmo-hlr_10.42.42.2(pid=25600): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25600)] 04:21:07.443336 run osmo-hlr_10.42.42.2(pid=25600): stdout: | (launched: 2022-12-10_04:21:04.500281) 04:21:07.493904 run osmo-hlr_10.42.42.2(pid=25600): stderr: | 20221210042104699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042104699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042104699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042104699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042104700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042104700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042104712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042104721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042104722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042104722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:07.564849 run osmo-msc_10.42.42.6(pid=25606): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25606)] 04:21:07.614086 run osmo-msc_10.42.42.6(pid=25606): stdout: | (launched: 2022-12-10_04:21:06.458232) 04:21:07.664770 run osmo-msc_10.42.42.6(pid=25606): stderr: | 20221210042106778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042106778 DLGLOBAL DEBUG validating counter group 0x7f1ad7715c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042106778 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042106778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042106778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042106779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042106780 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042106781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042106781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042106781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:07.716029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25599): Terminating (SIGTERM) 04:21:07.757036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25602): Terminating (SIGTERM) 04:21:07.797990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25605): Terminating (SIGTERM) 04:21:07.839320 --- ParallelTerminationStrategy: PID 25599 died... 04:21:07.858996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25599): Terminated: ok {rc=0} 04:21:07.904433 --- ParallelTerminationStrategy: PID 25602 died... 04:21:07.923740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25602): Terminated: ok {rc=0} 04:21:07.969212 --- ParallelTerminationStrategy: PID 25605 died... 04:21:07.988559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25605): Terminated: ok {rc=0} 04:21:08.074746 bus /sierra_3: Setting Powered False 04:21:09.173685 bus /sierra_3: Setting Powered False 04:21:10.290015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:21:11.532435 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:11.538864 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:21:11.573068 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:21:11.599655 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:21:11.651271 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:21:11.684334 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:21:11.711127 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:21:12.261843 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:21:12.309631 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:12.320840 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:21:12.388876 tst mo_mt_call.py: using LAC 25953 04:21:12.502967 tst mo_mt_call.py: using RAC 198 04:21:12.618025 tst mo_mt_call.py: using CellId 25953 04:21:12.734599 tst mo_mt_call.py: using BVCI 25954 04:21:12.842798 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:12.854085 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:12.865127 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:12.876567 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:12.888192 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:12.899602 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:21:13.016387 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:21:13.129625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:13.584079 run create_hlr_db(pid=25611): Launched 04:21:13.696341 bus /sierra_2: Setting Powered False 04:21:14.759116 run create_hlr_db(pid=25611): Terminated: ok {rc=0} 04:21:15.177914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25613): Launched 04:21:15.470301 run osmo-hlr_10.42.42.2(pid=25614): Launched 04:21:15.581807 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:16.098771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25616): Launched 04:21:16.433971 run osmo-stp_10.42.42.5(pid=25617): Launched 04:21:16.674466 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:17.328285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25619): Launched 04:21:17.641441 run osmo-msc_10.42.42.6(pid=25620): Launched 04:21:17.815041 run osmo-stp_10.42.42.5(pid=25617): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25617)] 04:21:17.947000 run osmo-stp_10.42.42.5(pid=25617): stdout: | (launched: 2022-12-10_04:21:16.369708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:18.079595 run osmo-stp_10.42.42.5(pid=25617): stderr: | 20221210042116664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042116664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042116664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042116665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042116665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042116665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042116665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:18.211220 run osmo-stp_10.42.42.5(pid=25617): stdout: | (launched: 2022-12-10_04:21:16.369708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:18.335212 run osmo-stp_10.42.42.5(pid=25617): stderr: | 20221210042116664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042116664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042116664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042116665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042116665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042116665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042116665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:18.483742 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25617): Process ended prematurely: osmo-stp_10.42.42.5(pid=25617) [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25617)] [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:21:18.493331 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:21:18.520498 run osmo-hlr_10.42.42.2(pid=25614): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25614)] 04:21:18.569396 run osmo-hlr_10.42.42.2(pid=25614): stdout: | (launched: 2022-12-10_04:21:15.417261) 04:21:18.620176 run osmo-hlr_10.42.42.2(pid=25614): stderr: | 20221210042115594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042115595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042115595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042115595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042115595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042115595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042115606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042115614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042115615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042115615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:18.690936 run osmo-msc_10.42.42.6(pid=25620): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25620)] 04:21:18.739861 run osmo-msc_10.42.42.6(pid=25620): stdout: | (launched: 2022-12-10_04:21:17.584694) 04:21:18.790443 run osmo-msc_10.42.42.6(pid=25620): stderr: | 20221210042117905 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042117905 DLGLOBAL DEBUG validating counter group 0x7f9fef1ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042117905 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042117905 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042117905 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042117905 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042117907 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042117907 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042117908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042117908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:18.841369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25613): Terminating (SIGTERM) 04:21:18.882182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25616): Terminating (SIGTERM) 04:21:18.923017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25619): Terminating (SIGTERM) 04:21:18.963982 --- ParallelTerminationStrategy: PID 25613 died... 04:21:18.983654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25613): Terminated: ok {rc=0} 04:21:19.029284 --- ParallelTerminationStrategy: PID 25616 died... 04:21:19.048428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25616): Terminated: ok {rc=0} 04:21:19.093468 --- ParallelTerminationStrategy: PID 25619 died... 04:21:19.112422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25619): Terminated: ok {rc=0} 04:21:19.198388 bus /sierra_3: Setting Powered False 04:21:20.295954 bus /sierra_3: Setting Powered False 04:21:21.411868 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:21:22.559851 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:22.572014 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:21:22.643844 tst mo_mt_call_osmux.py: using LAC 25954 04:21:22.766239 tst mo_mt_call_osmux.py: using RAC 199 04:21:22.889316 tst mo_mt_call_osmux.py: using CellId 25954 04:21:23.012053 tst mo_mt_call_osmux.py: using BVCI 25955 04:21:23.126730 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:23.138557 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:23.150058 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:23.161484 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:23.172925 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:21:23.184495 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:21:23.299648 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:21:23.416004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:23.898152 run create_hlr_db(pid=25622): Launched 04:21:24.024721 bus /sierra_2: Setting Powered False 04:21:25.084534 run create_hlr_db(pid=25622): Terminated: ok {rc=0} 04:21:25.519241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25624): Launched 04:21:25.831213 run osmo-hlr_10.42.42.2(pid=25625): Launched 04:21:25.950319 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:26.491371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25627): Launched 04:21:26.801788 run osmo-stp_10.42.42.5(pid=25628): Launched 04:21:26.920442 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:27.490725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25630): Launched 04:21:27.802587 run osmo-msc_10.42.42.6(pid=25631): Launched 04:21:27.975935 run osmo-stp_10.42.42.5(pid=25628): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25628)] 04:21:28.108758 run osmo-stp_10.42.42.5(pid=25628): stdout: | (launched: 2022-12-10_04:21:26.745669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:28.241150 run osmo-stp_10.42.42.5(pid=25628): stderr: | 20221210042126935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042126935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042126936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042126936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042126936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042126937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042126937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:28.372927 run osmo-stp_10.42.42.5(pid=25628): stdout: | (launched: 2022-12-10_04:21:26.745669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:28.497406 run osmo-stp_10.42.42.5(pid=25628): stderr: | 20221210042126935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042126935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042126936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042126936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042126936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042126937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042126937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:28.646481 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25628): Process ended prematurely: osmo-stp_10.42.42.5(pid=25628) [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25628)] [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:21:28.656173 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:21:28.684147 run osmo-hlr_10.42.42.2(pid=25625): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25625)] 04:21:28.733638 run osmo-hlr_10.42.42.2(pid=25625): stdout: | (launched: 2022-12-10_04:21:25.774696) 04:21:28.784828 run osmo-hlr_10.42.42.2(pid=25625): stderr: | 20221210042125974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042125974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042125974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042125974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042125974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042125974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042125987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042125998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042125998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042125998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:28.856326 run osmo-msc_10.42.42.6(pid=25631): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25631)] 04:21:28.905624 run osmo-msc_10.42.42.6(pid=25631): stdout: | (launched: 2022-12-10_04:21:27.746250) 04:21:28.956500 run osmo-msc_10.42.42.6(pid=25631): stderr: | 20221210042128066 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042128066 DLGLOBAL DEBUG validating counter group 0x7f3d5e3c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042128066 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042128066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042128067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042128067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042128068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042128069 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042128069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042128069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:29.008306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25624): Terminating (SIGTERM) 04:21:29.049485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25627): Terminating (SIGTERM) 04:21:29.090778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25630): Terminating (SIGTERM) 04:21:29.132366 --- ParallelTerminationStrategy: PID 25624 died... 04:21:29.152197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25624): Terminated: ok {rc=0} 04:21:29.197995 --- ParallelTerminationStrategy: PID 25627 died... 04:21:29.217464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25627): Terminated: ok {rc=0} 04:21:29.262853 --- ParallelTerminationStrategy: PID 25630 died... 04:21:29.282041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25630): Terminated: ok {rc=0} 04:21:29.368755 bus /sierra_3: Setting Powered False 04:21:30.464827 bus /sierra_3: Setting Powered False 04:21:31.575652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:21:32.827409 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:32.833701 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:21:32.867671 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:21:32.895021 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:21:32.947503 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:21:32.980775 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:21:33.008409 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:21:33.558581 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:21:33.608935 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:33.620492 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:21:33.691374 tst mo_mt_call.py: using LAC 25955 04:21:33.808873 tst mo_mt_call.py: using RAC 200 04:21:33.931724 tst mo_mt_call.py: using CellId 25955 04:21:34.054056 tst mo_mt_call.py: using BVCI 25956 04:21:34.167241 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:34.178757 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:34.190101 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:34.201425 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:34.212491 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:34.223698 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:21:34.336014 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:21:34.452607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:34.936677 run create_hlr_db(pid=25636): Launched 04:21:35.063818 bus /sierra_2: Setting Powered False 04:21:36.125556 run create_hlr_db(pid=25636): Terminated: ok {rc=0} 04:21:36.545061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25638): Launched 04:21:36.837550 run osmo-hlr_10.42.42.2(pid=25639): Launched 04:21:36.948778 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:37.453615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25641): Launched 04:21:37.746425 run osmo-stp_10.42.42.5(pid=25642): Launched 04:21:37.858465 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:38.388819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25644): Launched 04:21:38.682816 run osmo-msc_10.42.42.6(pid=25645): Launched 04:21:38.847028 run osmo-stp_10.42.42.5(pid=25642): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25642)] 04:21:38.971437 run osmo-stp_10.42.42.5(pid=25642): stdout: | (launched: 2022-12-10_04:21:37.693225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:39.096243 run osmo-stp_10.42.42.5(pid=25642): stderr: | 20221210042137860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042137860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042137861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042137861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042137862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042137862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042137862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:39.218759 run osmo-stp_10.42.42.5(pid=25642): stdout: | (launched: 2022-12-10_04:21:37.693225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:39.335829 run osmo-stp_10.42.42.5(pid=25642): stderr: | 20221210042137860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042137860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042137861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042137861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042137862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042137862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042137862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:39.476529 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25642): Process ended prematurely: osmo-stp_10.42.42.5(pid=25642) [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25642)] [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:21:39.485570 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 04:21:39.512115 run osmo-hlr_10.42.42.2(pid=25639): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25639)] 04:21:39.559001 run osmo-hlr_10.42.42.2(pid=25639): stdout: | (launched: 2022-12-10_04:21:36.784528) 04:21:39.607641 run osmo-hlr_10.42.42.2(pid=25639): stderr: | 20221210042136961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042136961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042136961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042136961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042136961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042136961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042136977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042136986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042136986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042136986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:39.675833 run osmo-msc_10.42.42.6(pid=25645): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25645)] 04:21:39.722848 run osmo-msc_10.42.42.6(pid=25645): stdout: | (launched: 2022-12-10_04:21:38.628903) 04:21:39.771512 run osmo-msc_10.42.42.6(pid=25645): stderr: | 20221210042138900 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042138900 DLGLOBAL DEBUG validating counter group 0x7f9532fb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042138900 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042138900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042138900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042138901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042138903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042138903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042138903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042138903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:39.820750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25638): Terminating (SIGTERM) 04:21:39.859828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25641): Terminating (SIGTERM) 04:21:39.898999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25644): Terminating (SIGTERM) 04:21:39.938236 --- ParallelTerminationStrategy: PID 25638 died... 04:21:39.960438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25638): Terminated: ok {rc=0} 04:21:40.007130 --- ParallelTerminationStrategy: PID 25641 died... 04:21:40.026361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25641): Terminated: ok {rc=0} 04:21:40.072821 --- ParallelTerminationStrategy: PID 25644 died... 04:21:40.092479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25644): Terminated: ok {rc=0} 04:21:40.179157 bus /sierra_3: Setting Powered False 04:21:41.277015 bus /sierra_3: Setting Powered False 04:21:42.394582 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:21:43.536539 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:43.547990 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:21:43.618469 tst mo_mt_call_osmux.py: using LAC 25956 04:21:43.734171 tst mo_mt_call_osmux.py: using RAC 201 04:21:43.850607 tst mo_mt_call_osmux.py: using CellId 25956 04:21:43.966621 tst mo_mt_call_osmux.py: using BVCI 25957 04:21:44.074366 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:44.085234 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:44.095852 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:44.106795 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:44.117834 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:21:44.129221 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:21:44.240727 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:21:44.355607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:44.837524 run create_hlr_db(pid=25647): Launched 04:21:44.964831 bus /sierra_2: Setting Powered False 04:21:46.026726 run create_hlr_db(pid=25647): Terminated: ok {rc=0} 04:21:46.480935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25649): Launched 04:21:46.876708 run osmo-hlr_10.42.42.2(pid=25650): Launched 04:21:47.054798 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:47.748211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25652): Launched 04:21:48.058614 run osmo-stp_10.42.42.5(pid=25653): Launched 04:21:48.177857 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:48.745159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25655): Launched 04:21:49.056496 run osmo-msc_10.42.42.6(pid=25656): Launched 04:21:49.229869 run osmo-stp_10.42.42.5(pid=25653): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25653)] 04:21:49.361085 run osmo-stp_10.42.42.5(pid=25653): stdout: | (launched: 2022-12-10_04:21:48.002059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:49.492530 run osmo-stp_10.42.42.5(pid=25653): stderr: | 20221210042148190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042148191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042148191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042148191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042148193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042148194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042148194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:49.623260 run osmo-stp_10.42.42.5(pid=25653): stdout: | (launched: 2022-12-10_04:21:48.002059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:49.747168 run osmo-stp_10.42.42.5(pid=25653): stderr: | 20221210042148190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042148191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042148191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042148191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042148193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042148194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042148194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:49.895510 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25653): Process ended prematurely: osmo-stp_10.42.42.5(pid=25653) [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25653)] [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:21:49.904935 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:21:49.932518 run osmo-hlr_10.42.42.2(pid=25650): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25650)] 04:21:49.981885 run osmo-hlr_10.42.42.2(pid=25650): stdout: | (launched: 2022-12-10_04:21:46.810542) 04:21:50.033312 run osmo-hlr_10.42.42.2(pid=25650): stderr: | 20221210042147187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042147187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042147187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042147187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042147187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042147187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042147215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042147230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042147230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042147230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:50.104345 run osmo-msc_10.42.42.6(pid=25656): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25656)] 04:21:50.153573 run osmo-msc_10.42.42.6(pid=25656): stdout: | (launched: 2022-12-10_04:21:48.999480) 04:21:50.204083 run osmo-msc_10.42.42.6(pid=25656): stderr: | 20221210042149323 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042149323 DLGLOBAL DEBUG validating counter group 0x7ff11213dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042149323 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042149323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042149324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042149324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042149326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042149326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042149326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042149326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:50.255097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25649): Terminating (SIGTERM) 04:21:50.296034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25652): Terminating (SIGTERM) 04:21:50.337142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25655): Terminating (SIGTERM) 04:21:50.378294 --- ParallelTerminationStrategy: PID 25649 died... 04:21:50.397853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25649): Terminated: ok {rc=0} 04:21:50.443218 --- ParallelTerminationStrategy: PID 25652 died... 04:21:50.462514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25652): Terminated: ok {rc=0} 04:21:50.507990 --- ParallelTerminationStrategy: PID 25655 died... 04:21:50.527397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25655): Terminated: ok {rc=0} 04:21:50.614609 bus /sierra_3: Setting Powered False 04:21:51.712576 bus /sierra_3: Setting Powered False 04:21:52.826825 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:trx-lms --------------------------------------------------------------------- 04:21:54.078327 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:54.083146 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 04:21:54.117228 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:21:54.144683 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 04:21:54.231061 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 04:21:54.264463 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:21:54.291701 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 04:21:54.876013 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 04:21:54.881204 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:21:54.892094 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 04:21:54.945558 tst emergency_mo_mt_call.py: using LAC 25957 04:21:55.065408 tst emergency_mo_mt_call.py: using RAC 202 04:21:55.184398 tst emergency_mo_mt_call.py: using CellId 25957 04:21:55.303008 tst emergency_mo_mt_call.py: using BVCI 25958 04:21:55.413516 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:21:55.424587 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:21:55.435554 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:21:55.446569 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:21:55.457497 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:21:55.468363 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:21:55.583322 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:21:55.700283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:56.173944 run create_hlr_db(pid=25662): Launched 04:21:56.297625 bus /sierra_2: Setting Powered False 04:21:57.358852 run create_hlr_db(pid=25662): Terminated: ok {rc=0} 04:21:57.785992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25664): Launched 04:21:58.090883 run osmo-hlr_10.42.42.2(pid=25665): Launched 04:21:58.206251 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:58.733669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25667): Launched 04:21:59.038327 run osmo-stp_10.42.42.5(pid=25668): Launched 04:21:59.168870 tst emergency_mo_mt_call.py: using MSISDN 7547 04:21:59.326659 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:59.877758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25670): Launched 04:22:00.183670 run osmo-msc_10.42.42.6(pid=25671): Launched 04:22:00.354331 run osmo-stp_10.42.42.5(pid=25668): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25668)] 04:22:00.483703 run osmo-stp_10.42.42.5(pid=25668): stdout: | (launched: 2022-12-10_04:21:58.982511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:00.613603 run osmo-stp_10.42.42.5(pid=25668): stderr: | 20221210042159172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042159172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042159173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042159173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042159174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042159174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042159174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:00.743465 run osmo-stp_10.42.42.5(pid=25668): stdout: | (launched: 2022-12-10_04:21:58.982511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:00.865936 run osmo-stp_10.42.42.5(pid=25668): stderr: | 20221210042159172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042159172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042159173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042159173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042159174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042159174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042159174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:01.014806 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25668): Process ended prematurely: osmo-stp_10.42.42.5(pid=25668) [trial-2369↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25668)] [trial-2369↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 04:22:01.024782 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 04:22:01.053153 run osmo-hlr_10.42.42.2(pid=25665): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25665)] 04:22:01.103424 run osmo-hlr_10.42.42.2(pid=25665): stdout: | (launched: 2022-12-10_04:21:58.035234) 04:22:01.155519 run osmo-hlr_10.42.42.2(pid=25665): stderr: | 20221210042158229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042158229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042158229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042158230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042158230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042158230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042158242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042158250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042158250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042158250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:01.228082 run osmo-msc_10.42.42.6(pid=25671): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25671)] 04:22:01.278166 run osmo-msc_10.42.42.6(pid=25671): stdout: | (launched: 2022-12-10_04:22:00.127952) 04:22:01.329895 run osmo-msc_10.42.42.6(pid=25671): stderr: | 20221210042200450 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042200450 DLGLOBAL DEBUG validating counter group 0x7fcd0c9bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042200451 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042200451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042200451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042200451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042200453 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042200453 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042200453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042200454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:01.381904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25664): Terminating (SIGTERM) 04:22:01.423770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25667): Terminating (SIGTERM) 04:22:01.465529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25670): Terminating (SIGTERM) 04:22:01.508314 --- ParallelTerminationStrategy: PID 25664 died... 04:22:01.528451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25664): Terminated: ok {rc=0} 04:22:01.577123 --- ParallelTerminationStrategy: PID 25667 died... 04:22:01.596882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25667): Terminated: ok {rc=0} 04:22:01.642896 --- ParallelTerminationStrategy: PID 25670 died... 04:22:01.662662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25670): Terminated: ok {rc=0} 04:22:01.749503 bus /sierra_3: Setting Powered False 04:22:02.845331 bus /sierra_3: Setting Powered False 04:22:03.958923 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 04:22:05.045144 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:05.056314 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 04:22:05.107377 tst emergency_preemptive_call.py: using LAC 25958 04:22:05.220483 tst emergency_preemptive_call.py: using RAC 203 04:22:05.333302 tst emergency_preemptive_call.py: using CellId 25958 04:22:05.445725 tst emergency_preemptive_call.py: using BVCI 25959 04:22:05.549543 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:05.560198 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:05.570638 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:05.581701 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:05.592418 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:05.603117 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:05.717792 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:05.831328 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:05.945106 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:06.061757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:06.537615 run create_hlr_db(pid=25673): Launched 04:22:06.662502 bus /sierra_2: Setting Powered False 04:22:07.723938 run create_hlr_db(pid=25673): Terminated: ok {rc=0} 04:22:08.133863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Launched 04:22:08.440191 run osmo-hlr_10.42.42.2(pid=25676): Launched 04:22:08.556610 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:09.088449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Launched 04:22:09.394784 run osmo-stp_10.42.42.5(pid=25679): Launched 04:22:09.520113 tst emergency_preemptive_call.py: using MSISDN 7548 04:22:09.678777 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:10.229399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25681): Launched 04:22:10.534694 run osmo-msc_10.42.42.6(pid=25682): Launched 04:22:10.705673 run osmo-stp_10.42.42.5(pid=25679): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] 04:22:10.835154 run osmo-stp_10.42.42.5(pid=25679): stdout: | (launched: 2022-12-10_04:22:09.339114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:10.965267 run osmo-stp_10.42.42.5(pid=25679): stderr: | 20221210042209528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042209528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042209528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042209529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042209529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042209529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042209529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:11.095390 run osmo-stp_10.42.42.5(pid=25679): stdout: | (launched: 2022-12-10_04:22:09.339114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:11.217197 run osmo-stp_10.42.42.5(pid=25679): stderr: | 20221210042209528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042209528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042209528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042209529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042209529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042209529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042209529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:11.363174 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25679): Process ended prematurely: osmo-stp_10.42.42.5(pid=25679) [trial-2369↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] [trial-2369↪emergency:trx-lms↪emergency_preemptive_call.py:32] 04:22:11.372070 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 04:22:11.399424 run osmo-hlr_10.42.42.2(pid=25676): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25676)] 04:22:11.449360 run osmo-hlr_10.42.42.2(pid=25676): stdout: | (launched: 2022-12-10_04:22:08.384326) 04:22:11.500778 run osmo-hlr_10.42.42.2(pid=25676): stderr: | 20221210042208581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042208581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042208581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042208581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042208581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042208581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042208594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042208602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042208602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042208602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:11.572451 run osmo-msc_10.42.42.6(pid=25682): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25682)] 04:22:11.622408 run osmo-msc_10.42.42.6(pid=25682): stdout: | (launched: 2022-12-10_04:22:10.479086) 04:22:11.674492 run osmo-msc_10.42.42.6(pid=25682): stderr: | 20221210042210798 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042210799 DLGLOBAL DEBUG validating counter group 0x7f422e034c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042210799 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042210799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042210799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042210799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042210801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042210801 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042210802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042210802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:11.726476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Terminating (SIGTERM) 04:22:11.767790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Terminating (SIGTERM) 04:22:11.809343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25681): Terminating (SIGTERM) 04:22:11.851174 --- ParallelTerminationStrategy: PID 25675 died... 04:22:11.871050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Terminated: ok {rc=0} 04:22:11.917155 --- ParallelTerminationStrategy: PID 25678 died... 04:22:11.936557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Terminated: ok {rc=0} 04:22:11.982152 --- ParallelTerminationStrategy: PID 25681 died... 04:22:12.001541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25681): Terminated: ok {rc=0} 04:22:12.089121 bus /sierra_9: Setting Powered False 04:22:13.187731 bus /sierra_9: Setting Powered False 04:22:14.302170 bus /sierra_8: Setting Powered False 04:22:15.399463 bus /sierra_8: Setting Powered False 04:22:16.525229 bus /sierra_3: Setting Powered False 04:22:17.638316 bus /sierra_3: Setting Powered False 04:22:18.753186 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms --------------------------------------------------------------------- 04:22:20.028547 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:22:20.034394 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 04:22:20.068380 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 04:22:20.107879 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 04:22:20.199028 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 04:22:20.233143 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 04:22:20.271200 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 04:22:20.861197 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 04:22:20.913351 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:20.924169 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:22:20.974694 tst cs_paging_gprs_active.py: using LAC 25959 04:22:21.097440 tst cs_paging_gprs_active.py: using RAC 204 04:22:21.219520 tst cs_paging_gprs_active.py: using CellId 25959 04:22:21.342830 tst cs_paging_gprs_active.py: using BVCI 25960 04:22:21.457650 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.468670 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.479565 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.490540 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.501345 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.512091 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.523055 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.533786 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:21.544609 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:22:21.657682 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:22:21.770718 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:22:21.968302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:22:22.263761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25687): Launched 04:22:22.518861 run iperf3-srv_10.42.42.10(pid=25688): Launched 04:22:22.629860 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:22:22.826429 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:22:23.121575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25689): Launched 04:22:23.376699 run iperf3-srv_10.42.42.10(pid=25690): Launched 04:22:23.487116 tst cs_paging_gprs_active.py:38: start network... 04:22:23.684699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:24.139431 run create_hlr_db(pid=25691): Launched 04:22:24.251682 bus /sierra_2: Setting Powered False 04:22:25.311734 run create_hlr_db(pid=25691): Terminated: ok {rc=0} 04:22:25.721590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25693): Launched 04:22:26.014665 run osmo-hlr_10.42.42.2(pid=25694): Launched 04:22:26.127044 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:26.631342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25696): Launched 04:22:26.924475 run osmo-stp_10.42.42.5(pid=25697): Launched 04:22:27.036659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:22:27.544554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25699): Launched 04:22:27.656584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:22:27.904860 run patchelf(pid=25700): Launched 04:22:28.068159 run osmo-stp_10.42.42.5(pid=25697): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25697)] 04:22:28.192411 run osmo-stp_10.42.42.5(pid=25697): stdout: | (launched: 2022-12-10_04:22:26.870870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:28.318671 run osmo-stp_10.42.42.5(pid=25697): stderr: | 20221210042227038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042227038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042227039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042227039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042227041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042227041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042227042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:28.445514 run osmo-stp_10.42.42.5(pid=25697): stdout: | (launched: 2022-12-10_04:22:26.870870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:28.565803 run osmo-stp_10.42.42.5(pid=25697): stderr: | 20221210042227038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042227038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042227039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042227039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042227041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042227041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042227042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:28.708611 run patchelf(pid=25700): Terminating (SIGINT) 04:22:28.873782 run patchelf(pid=25700): Terminated: ok {rc=0} 04:22:28.992722 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25697): Process ended prematurely: osmo-stp_10.42.42.5(pid=25697) [trial-2369↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25697)] [trial-2369↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 04:22:29.002433 tst cs_paging_gprs_active.py:38: Test FAILED (8.1 sec) 04:22:29.030336 run osmo-hlr_10.42.42.2(pid=25694): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25694)] 04:22:29.077738 run osmo-hlr_10.42.42.2(pid=25694): stdout: | (launched: 2022-12-10_04:22:25.960805) 04:22:29.127353 run osmo-hlr_10.42.42.2(pid=25694): stderr: | 20221210042226138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042226138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042226138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042226138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042226138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042226138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042226150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042226158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042226159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042226159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:29.177354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25687): Terminating (SIGTERM) 04:22:29.216921 run iperf3-srv_10.42.42.10(pid=25688): Terminating (SIGTERM) 04:22:29.256440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25689): Terminating (SIGTERM) 04:22:29.296026 run iperf3-srv_10.42.42.10(pid=25690): Terminating (SIGTERM) 04:22:29.335304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25693): Terminating (SIGTERM) 04:22:29.375712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25696): Terminating (SIGTERM) 04:22:29.415251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25699): Terminating (SIGTERM) 04:22:29.455116 --- ParallelTerminationStrategy: PID 25687 died... 04:22:29.474165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25687): Terminated: ok {rc=0} 04:22:29.518246 --- ParallelTerminationStrategy: PID 25688 died... 04:22:29.536470 run iperf3-srv_10.42.42.10(pid=25688): Terminated {rc=256} 04:22:29.580505 --- ParallelTerminationStrategy: PID 25689 died... 04:22:29.599313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25689): Terminated: ok {rc=0} 04:22:29.643304 --- ParallelTerminationStrategy: PID 25690 died... 04:22:29.661723 run iperf3-srv_10.42.42.10(pid=25690): Terminated {rc=256} 04:22:29.705186 --- ParallelTerminationStrategy: PID 25693 died... 04:22:29.723281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25693): Terminated: ok {rc=0} 04:22:29.766957 --- ParallelTerminationStrategy: PID 25696 died... 04:22:29.785473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25696): Terminated: ok {rc=0} 04:22:29.829538 --- ParallelTerminationStrategy: PID 25699 died... 04:22:29.847854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25699): Terminated: ok {rc=0} 04:22:29.931220 bus /gobi_0: Setting Powered False 04:22:31.023094 bus /gobi_0: Setting Powered False 04:22:32.150377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms iperf3.py ---------------------------------------------- 04:22:33.298545 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.309541 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:22:33.360852 tst iperf3.py: using LAC 25960 04:22:33.475682 tst iperf3.py: using RAC 205 04:22:33.599826 tst iperf3.py: using CellId 25960 04:22:33.727170 tst iperf3.py: using BVCI 25961 04:22:33.840765 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.851854 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.862677 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.873520 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.884214 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.895069 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.905983 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.916785 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:33.927722 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:22:34.040067 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:22:34.237521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:22:34.530967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25701): Launched 04:22:34.785886 run iperf3-srv_10.42.42.10(pid=25702): Launched 04:22:34.895980 tst iperf3.py:8: start network... 04:22:35.092434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:35.544777 run create_hlr_db(pid=25703): Launched 04:22:35.657468 bus /gobi_6: Setting Powered False 04:22:36.716474 run create_hlr_db(pid=25703): Terminated: ok {rc=0} 04:22:37.145055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Launched 04:22:37.458249 run osmo-hlr_10.42.42.2(pid=25707): Launched 04:22:37.579778 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:38.120203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Launched 04:22:38.433096 run osmo-stp_10.42.42.5(pid=25710): Launched 04:22:38.553467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:22:39.096796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25712): Launched 04:22:39.210928 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:22:39.459166 run patchelf(pid=25713): Launched 04:22:39.622147 run osmo-stp_10.42.42.5(pid=25710): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] 04:22:39.747734 run osmo-stp_10.42.42.5(pid=25710): stdout: | (launched: 2022-12-10_04:22:38.376667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:39.874876 run osmo-stp_10.42.42.5(pid=25710): stderr: | 20221210042238567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042238567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042238567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042238568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042238568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042238568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042238568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:40.002253 run osmo-stp_10.42.42.5(pid=25710): stdout: | (launched: 2022-12-10_04:22:38.376667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:40.123309 run osmo-stp_10.42.42.5(pid=25710): stderr: | 20221210042238567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042238567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042238567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042238568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042238568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042238568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042238568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:40.266570 run patchelf(pid=25713): Terminating (SIGINT) 04:22:40.431907 run patchelf(pid=25713): Terminated: ok {rc=0} 04:22:40.551286 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25710): Process ended prematurely: osmo-stp_10.42.42.5(pid=25710) [trial-2369↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] [trial-2369↪gprs:trx-lms↪iperf3.py:8] 04:22:40.560840 tst iperf3.py:8: Test FAILED (7.3 sec) 04:22:40.588474 run osmo-hlr_10.42.42.2(pid=25707): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25707)] 04:22:40.636092 run osmo-hlr_10.42.42.2(pid=25707): stdout: | (launched: 2022-12-10_04:22:37.401771) 04:22:40.685427 run osmo-hlr_10.42.42.2(pid=25707): stderr: | 20221210042237599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042237599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042237599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042237599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042237599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042237599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042237612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042237622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042237622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042237622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:40.734930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25701): Terminating (SIGTERM) 04:22:40.774899 run iperf3-srv_10.42.42.10(pid=25702): Terminating (SIGTERM) 04:22:40.814422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Terminating (SIGTERM) 04:22:40.854028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Terminating (SIGTERM) 04:22:40.893690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25712): Terminating (SIGTERM) 04:22:40.933496 --- ParallelTerminationStrategy: PID 25701 died... 04:22:40.952448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25701): Terminated: ok {rc=0} 04:22:40.996641 --- ParallelTerminationStrategy: PID 25702 died... 04:22:41.015518 run iperf3-srv_10.42.42.10(pid=25702): Terminated {rc=256} 04:22:41.059515 --- ParallelTerminationStrategy: PID 25706 died... 04:22:41.078041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25706): Terminated: ok {rc=0} 04:22:41.121907 --- ParallelTerminationStrategy: PID 25709 died... 04:22:41.140195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25709): Terminated: ok {rc=0} 04:22:41.183843 --- ParallelTerminationStrategy: PID 25712 died... 04:22:41.202300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25712): Terminated: ok {rc=0} 04:22:41.286676 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms iperf3m4.py ---------------------------------------------- 04:22:42.429817 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:42.440825 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:22:42.489778 tst iperf3m4.py: using LAC 25961 04:22:42.614468 tst iperf3m4.py: using RAC 206 04:22:42.736409 tst iperf3m4.py: using CellId 25961 04:22:42.858447 tst iperf3m4.py: using BVCI 25962 04:22:42.971314 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:42.982565 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:42.993584 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:43.004369 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:43.015098 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:43.025938 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:43.037461 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:43.048205 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:22:43.059097 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:22:43.178075 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:22:43.299835 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:22:43.413075 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:22:43.528304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:22:43.726696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:22:44.021256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25714): Launched 04:22:44.275934 run iperf3-srv_10.42.42.10(pid=25715): Launched 04:22:44.385830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:22:44.582191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:22:44.876164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25716): Launched 04:22:45.131269 run iperf3-srv_10.42.42.10(pid=25717): Launched 04:22:45.241663 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:22:45.438593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:22:45.733268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25718): Launched 04:22:46.013657 run iperf3-srv_10.42.42.10(pid=25719): Launched 04:22:46.147675 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:22:46.366384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:22:46.696691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25720): Launched 04:22:46.991946 run iperf3-srv_10.42.42.10(pid=25721): Launched 04:22:47.120172 tst iperf3m4.py:8: start network... 04:22:47.332468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:47.815905 run create_hlr_db(pid=25722): Launched 04:22:47.943051 bus /gobi_6: Setting Powered False 04:22:49.004896 run create_hlr_db(pid=25722): Terminated: ok {rc=0} 04:22:49.423737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25724): Launched 04:22:49.738084 run osmo-hlr_10.42.42.2(pid=25725): Launched 04:22:49.856430 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:50.397378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25727): Launched 04:22:50.707792 run osmo-stp_10.42.42.5(pid=25728): Launched 04:22:50.825283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:22:51.362207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25730): Launched 04:22:51.481423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:22:51.744895 run patchelf(pid=25731): Launched 04:22:51.918691 run osmo-stp_10.42.42.5(pid=25728): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25728)] 04:22:52.052266 run osmo-stp_10.42.42.5(pid=25728): stdout: | (launched: 2022-12-10_04:22:50.651459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:52.186617 run osmo-stp_10.42.42.5(pid=25728): stderr: | 20221210042250839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042250839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042250840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042250840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042250840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042250841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042250841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:52.320579 run osmo-stp_10.42.42.5(pid=25728): stdout: | (launched: 2022-12-10_04:22:50.651459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:52.448465 run osmo-stp_10.42.42.5(pid=25728): stderr: | 20221210042250839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042250839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042250840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042250840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042250840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042250841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042250841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:52.600003 run patchelf(pid=25731): Terminating (SIGINT) 04:22:52.774649 run patchelf(pid=25731): Terminated: ok {rc=0} 04:22:52.900468 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25728): Process ended prematurely: osmo-stp_10.42.42.5(pid=25728) [trial-2369↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25728)] [trial-2369↪gprs:trx-lms↪iperf3m4.py:8] 04:22:52.910793 tst iperf3m4.py:8: Test FAILED (10.5 sec) 04:22:52.939262 run osmo-hlr_10.42.42.2(pid=25725): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25725)] 04:22:52.988918 run osmo-hlr_10.42.42.2(pid=25725): stdout: | (launched: 2022-12-10_04:22:49.681602) 04:22:53.039894 run osmo-hlr_10.42.42.2(pid=25725): stderr: | 20221210042249876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042249876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042249876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042249876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042249876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042249876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042249890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042249900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042249901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042249901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:53.091089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25714): Terminating (SIGTERM) 04:22:53.132456 run iperf3-srv_10.42.42.10(pid=25715): Terminating (SIGTERM) 04:22:53.173861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25716): Terminating (SIGTERM) 04:22:53.215338 run iperf3-srv_10.42.42.10(pid=25717): Terminating (SIGTERM) 04:22:53.256698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25718): Terminating (SIGTERM) 04:22:53.298223 run iperf3-srv_10.42.42.10(pid=25719): Terminating (SIGTERM) 04:22:53.339731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25720): Terminating (SIGTERM) 04:22:53.381601 run iperf3-srv_10.42.42.10(pid=25721): Terminating (SIGTERM) 04:22:53.422924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25724): Terminating (SIGTERM) 04:22:53.464282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25727): Terminating (SIGTERM) 04:22:53.505564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25730): Terminating (SIGTERM) 04:22:53.547233 --- ParallelTerminationStrategy: PID 25714 died... 04:22:53.567081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25714): Terminated: ok {rc=0} 04:22:53.613008 --- ParallelTerminationStrategy: PID 25715 died... 04:22:53.632451 run iperf3-srv_10.42.42.10(pid=25715): Terminated {rc=256} 04:22:53.678147 --- ParallelTerminationStrategy: PID 25716 died... 04:22:53.697659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25716): Terminated: ok {rc=0} 04:22:53.743262 --- ParallelTerminationStrategy: PID 25717 died... 04:22:53.762583 run iperf3-srv_10.42.42.10(pid=25717): Terminated {rc=256} 04:22:53.808313 --- ParallelTerminationStrategy: PID 25718 died... 04:22:53.827733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25718): Terminated: ok {rc=0} 04:22:53.873392 --- ParallelTerminationStrategy: PID 25719 died... 04:22:53.892570 run iperf3-srv_10.42.42.10(pid=25719): Terminated {rc=256} 04:22:53.938181 --- ParallelTerminationStrategy: PID 25720 died... 04:22:53.957633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25720): Terminated: ok {rc=0} 04:22:54.003792 --- ParallelTerminationStrategy: PID 25721 died... 04:22:54.023187 run iperf3-srv_10.42.42.10(pid=25721): Terminated {rc=256} 04:22:54.069259 --- ParallelTerminationStrategy: PID 25724 died... 04:22:54.088545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25724): Terminated: ok {rc=0} 04:22:54.134358 --- ParallelTerminationStrategy: PID 25727 died... 04:22:54.153772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25727): Terminated: ok {rc=0} 04:22:54.199446 --- ParallelTerminationStrategy: PID 25730 died... 04:22:54.218819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25730): Terminated: ok {rc=0} 04:22:54.306213 bus /gobi_4: Setting Powered False 04:22:55.404364 bus /gobi_4: Setting Powered False 04:22:56.520399 bus /gobi_1: Setting Powered False 04:22:57.615869 bus /gobi_1: Setting Powered False 04:22:58.730600 bus /gobi_0: Setting Powered False 04:22:59.826826 bus /gobi_0: Setting Powered False 04:23:00.955120 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms ping.py ---------------------------------------------- 04:23:02.070475 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.086840 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:02.150066 tst ping.py: using LAC 25962 04:23:02.295761 tst ping.py: using RAC 207 04:23:02.425735 tst ping.py: using CellId 25962 04:23:02.547002 tst ping.py: using BVCI 25963 04:23:02.657701 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.668682 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.679613 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.690471 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.701303 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.712040 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.722969 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:02.733873 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:02.847197 tst ping.py:19: start network... 04:23:03.039633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:03.484689 run create_hlr_db(pid=25733): Launched 04:23:03.594702 bus /gobi_6: Setting Powered False 04:23:04.652914 run create_hlr_db(pid=25733): Terminated: ok {rc=0} 04:23:05.074003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Launched 04:23:05.380048 run osmo-hlr_10.42.42.2(pid=25736): Launched 04:23:05.496850 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:06.027838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Launched 04:23:06.335000 run osmo-stp_10.42.42.5(pid=25739): Launched 04:23:06.451404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:06.980713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25741): Launched 04:23:07.098707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:07.357554 run patchelf(pid=25742): Launched 04:23:07.527973 run osmo-stp_10.42.42.5(pid=25739): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] 04:23:07.659166 run osmo-stp_10.42.42.5(pid=25739): stdout: | (launched: 2022-12-10_04:23:06.279506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:07.791443 run osmo-stp_10.42.42.5(pid=25739): stderr: | 20221210042306468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042306468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042306469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042306469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042306469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042306470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042306470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:07.923837 run osmo-stp_10.42.42.5(pid=25739): stdout: | (launched: 2022-12-10_04:23:06.279506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:08.050776 run osmo-stp_10.42.42.5(pid=25739): stderr: | 20221210042306468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042306468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042306469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042306469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042306469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042306470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042306470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:08.201134 run patchelf(pid=25742): Terminating (SIGINT) 04:23:08.373572 run patchelf(pid=25742): Terminated: ok {rc=0} 04:23:08.498101 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25739): Process ended prematurely: osmo-stp_10.42.42.5(pid=25739) [trial-2369↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] [trial-2369↪gprs:trx-lms↪ping.py:22] 04:23:08.507616 tst ping.py:22: Test FAILED (6.4 sec) 04:23:08.535540 run osmo-hlr_10.42.42.2(pid=25736): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25736)] 04:23:08.584919 run osmo-hlr_10.42.42.2(pid=25736): stdout: | (launched: 2022-12-10_04:23:05.324549) 04:23:08.636009 run osmo-hlr_10.42.42.2(pid=25736): stderr: | 20221210042305523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042305523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042305523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042305523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042305523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042305523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042305536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042305544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042305544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042305544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:08.687665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Terminating (SIGTERM) 04:23:08.729165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Terminating (SIGTERM) 04:23:08.770836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25741): Terminating (SIGTERM) 04:23:08.812515 --- ParallelTerminationStrategy: PID 25735 died... 04:23:08.832565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Terminated: ok {rc=0} 04:23:08.878282 --- ParallelTerminationStrategy: PID 25738 died... 04:23:08.897763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Terminated: ok {rc=0} 04:23:08.943269 --- ParallelTerminationStrategy: PID 25741 died... 04:23:08.962654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25741): Terminated: ok {rc=0} 04:23:09.049708 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 04:23:10.137865 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.149989 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:10.201582 tst ping_idle_ping.py: using LAC 25963 04:23:10.323807 tst ping_idle_ping.py: using RAC 208 04:23:10.444592 tst ping_idle_ping.py: using CellId 25963 04:23:10.561310 tst ping_idle_ping.py: using BVCI 25964 04:23:10.667667 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.678725 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.689441 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.700554 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.711547 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.722250 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.733097 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:10.743797 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:10.855397 tst ping_idle_ping.py:24: start network... 04:23:11.048914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:11.499051 run create_hlr_db(pid=25743): Launched 04:23:11.609994 bus /gobi_6: Setting Powered False 04:23:12.669248 run create_hlr_db(pid=25743): Terminated: ok {rc=0} 04:23:13.074370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25745): Launched 04:23:13.364084 run osmo-hlr_10.42.42.2(pid=25746): Launched 04:23:13.475245 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:13.973971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25748): Launched 04:23:14.263950 run osmo-stp_10.42.42.5(pid=25749): Launched 04:23:14.374560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:14.874852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25751): Launched 04:23:14.985589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:15.230198 run patchelf(pid=25752): Launched 04:23:15.391325 run osmo-stp_10.42.42.5(pid=25749): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25749)] 04:23:15.514707 run osmo-stp_10.42.42.5(pid=25749): stdout: | (launched: 2022-12-10_04:23:14.211055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:15.639370 run osmo-stp_10.42.42.5(pid=25749): stderr: | 20221210042314379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042314379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042314380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042314380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042314381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042314381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042314381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:15.763808 run osmo-stp_10.42.42.5(pid=25749): stdout: | (launched: 2022-12-10_04:23:14.211055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:15.895811 run osmo-stp_10.42.42.5(pid=25749): stderr: | 20221210042314379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042314379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042314380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042314380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042314381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042314381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042314381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:16.061504 run patchelf(pid=25752): Terminating (SIGINT) 04:23:16.258845 run patchelf(pid=25752): Terminated: ok {rc=0} 04:23:16.409383 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25749): Process ended prematurely: osmo-stp_10.42.42.5(pid=25749) [trial-2369↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25749)] [trial-2369↪gprs:trx-lms↪ping_idle_ping.py:27] 04:23:16.421605 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:23:16.455889 run osmo-hlr_10.42.42.2(pid=25746): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25746)] 04:23:16.520320 run osmo-hlr_10.42.42.2(pid=25746): stdout: | (launched: 2022-12-10_04:23:13.311239) 04:23:16.576122 run osmo-hlr_10.42.42.2(pid=25746): stderr: | 20221210042313483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042313483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042313483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042313484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042313484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042313484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042313496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042313505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042313505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042313505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:16.635315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25745): Terminating (SIGTERM) 04:23:16.684586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25748): Terminating (SIGTERM) 04:23:16.737765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25751): Terminating (SIGTERM) 04:23:16.782924 --- ParallelTerminationStrategy: PID 25745 died... 04:23:16.803316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25745): Terminated: ok {rc=0} 04:23:16.851625 --- ParallelTerminationStrategy: PID 25748 died... 04:23:16.871648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25748): Terminated: ok {rc=0} 04:23:16.919380 --- ParallelTerminationStrategy: PID 25751 died... 04:23:16.939434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25751): Terminated: ok {rc=0} 04:23:17.037551 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 04:23:18.410924 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:23:18.417028 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:23:18.461785 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:23:18.513358 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:23:18.612348 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:23:18.673441 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:23:18.731868 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:23:19.278419 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:23:19.332898 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.345476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:23:19.396876 tst cs_paging_gprs_active.py: using LAC 25964 04:23:19.524000 tst cs_paging_gprs_active.py: using RAC 209 04:23:19.650461 tst cs_paging_gprs_active.py: using CellId 25964 04:23:19.776822 tst cs_paging_gprs_active.py: using BVCI 25965 04:23:19.893504 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.906371 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.918006 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.929901 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.941611 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.953569 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.965829 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.977582 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:19.989739 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:23:20.112697 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:23:20.232701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:23:20.454368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:20.789715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26027): Launched 04:23:21.065735 run iperf3-srv_10.42.42.10(pid=26029): Launched 04:23:21.183174 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:23:21.382707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:21.692487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26030): Launched 04:23:21.969856 run iperf3-srv_10.42.42.10(pid=26031): Launched 04:23:22.096789 tst cs_paging_gprs_active.py:38: start network... 04:23:22.299477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:22.766999 run create_hlr_db(pid=26032): Launched 04:23:22.924699 bus /gobi_6: Setting Powered False 04:23:23.986700 run create_hlr_db(pid=26032): Terminated: ok {rc=0} 04:23:24.424588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Launched 04:23:24.754197 run osmo-hlr_10.42.42.2(pid=26035): Launched 04:23:24.992938 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:25.728886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Launched 04:23:26.056111 run osmo-stp_10.42.42.5(pid=26038): Launched 04:23:26.296908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:26.993193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26040): Launched 04:23:27.125789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:27.394029 run patchelf(pid=26041): Launched 04:23:27.587266 run osmo-stp_10.42.42.5(pid=26038): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] 04:23:27.722019 run osmo-stp_10.42.42.5(pid=26038): stdout: | (launched: 2022-12-10_04:23:25.996731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:27.857463 run osmo-stp_10.42.42.5(pid=26038): stderr: | 20221210042326324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042326324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042326324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042326324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042326325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042326325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042326325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:27.994912 run osmo-stp_10.42.42.5(pid=26038): stdout: | (launched: 2022-12-10_04:23:25.996731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:28.125287 run osmo-stp_10.42.42.5(pid=26038): stderr: | 20221210042326324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042326324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042326324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042326324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042326325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042326325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042326325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:28.278712 run patchelf(pid=26041): Terminating (SIGINT) 04:23:28.457176 run patchelf(pid=26041): Terminated: ok {rc=0} 04:23:28.587218 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26038): Process ended prematurely: osmo-stp_10.42.42.5(pid=26038) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:23:28.598191 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 04:23:28.629364 run osmo-hlr_10.42.42.2(pid=26035): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26035)] 04:23:28.680676 run osmo-hlr_10.42.42.2(pid=26035): stdout: | (launched: 2022-12-10_04:23:24.693851) 04:23:28.733938 run osmo-hlr_10.42.42.2(pid=26035): stderr: | 20221210042325040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042325040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042325040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042325040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042325040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042325040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042325060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042325078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042325078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042325078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:28.786743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26027): Terminating (SIGTERM) 04:23:28.829534 run iperf3-srv_10.42.42.10(pid=26029): Terminating (SIGTERM) 04:23:28.874839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26030): Terminating (SIGTERM) 04:23:28.919100 run iperf3-srv_10.42.42.10(pid=26031): Terminating (SIGTERM) 04:23:28.965291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Terminating (SIGTERM) 04:23:29.009006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Terminating (SIGTERM) 04:23:29.053421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26040): Terminating (SIGTERM) 04:23:29.098826 --- ParallelTerminationStrategy: PID 26027 died... 04:23:29.118337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26027): Terminated: ok {rc=0} 04:23:29.167812 --- ParallelTerminationStrategy: PID 26029 died... 04:23:29.187737 run iperf3-srv_10.42.42.10(pid=26029): Terminated {rc=256} 04:23:29.235440 --- ParallelTerminationStrategy: PID 26030 died... 04:23:29.255197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26030): Terminated: ok {rc=0} 04:23:29.304045 --- ParallelTerminationStrategy: PID 26031 died... 04:23:29.323752 run iperf3-srv_10.42.42.10(pid=26031): Terminated {rc=256} 04:23:29.371480 --- ParallelTerminationStrategy: PID 26034 died... 04:23:29.391216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Terminated: ok {rc=0} 04:23:29.438723 --- ParallelTerminationStrategy: PID 26037 died... 04:23:29.458858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Terminated: ok {rc=0} 04:23:29.507978 --- ParallelTerminationStrategy: PID 26040 died... 04:23:29.528006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26040): Terminated: ok {rc=0} 04:23:29.617209 bus /gobi_0: Setting Powered False 04:23:30.717726 bus /gobi_0: Setting Powered False 04:23:31.843840 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:23:33.002569 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.015230 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:23:33.069315 tst iperf3.py: using LAC 25965 04:23:33.193409 tst iperf3.py: using RAC 210 04:23:33.317954 tst iperf3.py: using CellId 25965 04:23:33.439907 tst iperf3.py: using BVCI 25966 04:23:33.556581 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.569142 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.581132 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.594732 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.607619 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.619222 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.632548 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.646549 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:33.659541 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:23:33.778862 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:23:33.992621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:34.314093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26042): Launched 04:23:34.606187 run iperf3-srv_10.42.42.10(pid=26043): Launched 04:23:34.740860 tst iperf3.py:8: start network... 04:23:34.954060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:35.445416 run create_hlr_db(pid=26044): Launched 04:23:35.607957 bus /gobi_6: Setting Powered False 04:23:36.669991 run create_hlr_db(pid=26044): Terminated: ok {rc=0} 04:23:37.119294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26046): Launched 04:23:37.459693 run osmo-hlr_10.42.42.2(pid=26047): Launched 04:23:37.700656 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:38.370608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26049): Launched 04:23:38.708571 run osmo-stp_10.42.42.5(pid=26051): Launched 04:23:38.831442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:39.388738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26053): Launched 04:23:39.512016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:39.783851 run patchelf(pid=26054): Launched 04:23:39.962958 run osmo-stp_10.42.42.5(pid=26051): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26051)] 04:23:40.100032 run osmo-stp_10.42.42.5(pid=26051): stdout: | (launched: 2022-12-10_04:23:38.649311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:40.238279 run osmo-stp_10.42.42.5(pid=26051): stderr: | 20221210042338840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042338840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042338840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042338841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042338841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042338841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042338841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:40.376572 run osmo-stp_10.42.42.5(pid=26051): stdout: | (launched: 2022-12-10_04:23:38.649311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:40.508649 run osmo-stp_10.42.42.5(pid=26051): stderr: | 20221210042338840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042338840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042338840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042338841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042338841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042338841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042338841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:40.664734 run patchelf(pid=26054): Terminating (SIGINT) 04:23:40.844875 run patchelf(pid=26054): Terminated: ok {rc=0} 04:23:40.974953 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26051): Process ended prematurely: osmo-stp_10.42.42.5(pid=26051) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26051)] [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 04:23:40.985432 tst iperf3.py:8: Test FAILED (8.0 sec) 04:23:41.014005 run osmo-hlr_10.42.42.2(pid=26047): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26047)] 04:23:41.063827 run osmo-hlr_10.42.42.2(pid=26047): stdout: | (launched: 2022-12-10_04:23:37.398114) 04:23:41.115210 run osmo-hlr_10.42.42.2(pid=26047): stderr: | 20221210042337705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042337705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042337705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042337705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042337705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042337705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042337727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042337744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042337744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042337744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:41.166959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26042): Terminating (SIGTERM) 04:23:41.208816 run iperf3-srv_10.42.42.10(pid=26043): Terminating (SIGTERM) 04:23:41.250641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26046): Terminating (SIGTERM) 04:23:41.291926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26049): Terminating (SIGTERM) 04:23:41.333962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26053): Terminating (SIGTERM) 04:23:41.376300 --- ParallelTerminationStrategy: PID 26042 died... 04:23:41.396383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26042): Terminated: ok {rc=0} 04:23:41.442910 --- ParallelTerminationStrategy: PID 26043 died... 04:23:41.462607 run iperf3-srv_10.42.42.10(pid=26043): Terminated {rc=256} 04:23:41.508528 --- ParallelTerminationStrategy: PID 26046 died... 04:23:41.528193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26046): Terminated: ok {rc=0} 04:23:41.574181 --- ParallelTerminationStrategy: PID 26049 died... 04:23:41.593719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26049): Terminated: ok {rc=0} 04:23:41.640203 --- ParallelTerminationStrategy: PID 26053 died... 04:23:41.659926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26053): Terminated: ok {rc=0} 04:23:41.748881 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:23:42.896515 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:42.908123 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:23:42.957413 tst iperf3m4.py: using LAC 25966 04:23:43.076880 tst iperf3m4.py: using RAC 211 04:23:43.194459 tst iperf3m4.py: using CellId 25966 04:23:43.313319 tst iperf3m4.py: using BVCI 25967 04:23:43.423111 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.434227 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.445051 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.456304 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.467588 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.478902 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.490414 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.501458 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:23:43.512690 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:23:43.632168 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:23:43.748825 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:23:43.862584 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:23:43.978717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:23:44.183270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:44.487741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26055): Launched 04:23:44.751799 run iperf3-srv_10.42.42.10(pid=26056): Launched 04:23:44.866009 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:23:45.069988 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:45.374641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Launched 04:23:45.638569 run iperf3-srv_10.42.42.10(pid=26058): Launched 04:23:45.752435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:23:45.983082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:46.321841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Launched 04:23:46.622414 run iperf3-srv_10.42.42.10(pid=26060): Launched 04:23:46.759934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:23:46.983670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:47.313229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Launched 04:23:47.594458 run iperf3-srv_10.42.42.10(pid=26062): Launched 04:23:47.715108 tst iperf3m4.py:8: start network... 04:23:47.933319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:48.437547 run create_hlr_db(pid=26063): Launched 04:23:48.568549 bus /gobi_6: Setting Powered False 04:23:49.633418 run create_hlr_db(pid=26063): Terminated: ok {rc=0} 04:23:50.083569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26065): Launched 04:23:50.407668 run osmo-hlr_10.42.42.2(pid=26066): Launched 04:23:50.531337 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:51.093586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26068): Launched 04:23:51.416335 run osmo-stp_10.42.42.5(pid=26069): Launched 04:23:51.539538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:52.097260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26071): Launched 04:23:52.220674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:52.493534 run patchelf(pid=26072): Launched 04:23:52.672232 run osmo-stp_10.42.42.5(pid=26069): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26069)] 04:23:52.809684 run osmo-stp_10.42.42.5(pid=26069): stdout: | (launched: 2022-12-10_04:23:51.357664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:52.948191 run osmo-stp_10.42.42.5(pid=26069): stderr: | 20221210042351553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042351553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042351553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042351554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042351554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042351554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042351554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:53.086955 run osmo-stp_10.42.42.5(pid=26069): stdout: | (launched: 2022-12-10_04:23:51.357664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:53.218944 run osmo-stp_10.42.42.5(pid=26069): stderr: | 20221210042351553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042351553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042351553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042351554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042351554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042351554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042351554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:53.375696 run patchelf(pid=26072): Terminating (SIGINT) 04:23:53.556259 run patchelf(pid=26072): Terminated: ok {rc=0} 04:23:53.686595 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26069): Process ended prematurely: osmo-stp_10.42.42.5(pid=26069) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26069)] [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 04:23:53.696843 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:23:53.726131 run osmo-hlr_10.42.42.2(pid=26066): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26066)] 04:23:53.776367 run osmo-hlr_10.42.42.2(pid=26066): stdout: | (launched: 2022-12-10_04:23:50.348822) 04:23:53.828387 run osmo-hlr_10.42.42.2(pid=26066): stderr: | 20221210042350549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042350549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042350549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042350549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042350549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042350549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042350562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042350570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042350570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042350570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:53.880703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26055): Terminating (SIGTERM) 04:23:53.922945 run iperf3-srv_10.42.42.10(pid=26056): Terminating (SIGTERM) 04:23:53.965037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Terminating (SIGTERM) 04:23:54.007482 run iperf3-srv_10.42.42.10(pid=26058): Terminating (SIGTERM) 04:23:54.049813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminating (SIGTERM) 04:23:54.092178 run iperf3-srv_10.42.42.10(pid=26060): Terminating (SIGTERM) 04:23:54.134615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminating (SIGTERM) 04:23:54.176921 run iperf3-srv_10.42.42.10(pid=26062): Terminating (SIGTERM) 04:23:54.218950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26065): Terminating (SIGTERM) 04:23:54.261146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26068): Terminating (SIGTERM) 04:23:54.303188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26071): Terminating (SIGTERM) 04:23:54.345644 --- ParallelTerminationStrategy: PID 26055 died... 04:23:54.365797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26055): Terminated: ok {rc=0} 04:23:54.412457 --- ParallelTerminationStrategy: PID 26056 died... 04:23:54.432199 run iperf3-srv_10.42.42.10(pid=26056): Terminated {rc=256} 04:23:54.479167 --- ParallelTerminationStrategy: PID 26057 died... 04:23:54.499077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26057): Terminated: ok {rc=0} 04:23:54.545574 --- ParallelTerminationStrategy: PID 26058 died... 04:23:54.565259 run iperf3-srv_10.42.42.10(pid=26058): Terminated {rc=256} 04:23:54.611674 --- ParallelTerminationStrategy: PID 26059 died... 04:23:54.631424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminated: ok {rc=0} 04:23:54.677685 --- ParallelTerminationStrategy: PID 26060 died... 04:23:54.697358 run iperf3-srv_10.42.42.10(pid=26060): Terminated {rc=256} 04:23:54.743714 --- ParallelTerminationStrategy: PID 26061 died... 04:23:54.763581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminated: ok {rc=0} 04:23:54.810255 --- ParallelTerminationStrategy: PID 26062 died... 04:23:54.830056 run iperf3-srv_10.42.42.10(pid=26062): Terminated {rc=256} 04:23:54.876346 --- ParallelTerminationStrategy: PID 26065 died... 04:23:54.896243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26065): Terminated: ok {rc=0} 04:23:54.942632 --- ParallelTerminationStrategy: PID 26068 died... 04:23:54.962378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26068): Terminated: ok {rc=0} 04:23:55.008871 --- ParallelTerminationStrategy: PID 26071 died... 04:23:55.028690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26071): Terminated: ok {rc=0} 04:23:55.117644 bus /gobi_4: Setting Powered False 04:23:56.218318 bus /gobi_4: Setting Powered False 04:23:57.334338 bus /gobi_1: Setting Powered False 04:23:58.433618 bus /gobi_1: Setting Powered False 04:23:59.549468 bus /gobi_0: Setting Powered False 04:24:00.649063 bus /gobi_0: Setting Powered False 04:24:01.779903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 04:24:02.893314 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:02.904676 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:02.957440 tst ping.py: using LAC 25967 04:24:03.084694 tst ping.py: using RAC 212 04:24:03.215898 tst ping.py: using CellId 25967 04:24:03.341725 tst ping.py: using BVCI 25968 04:24:03.450938 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:03.462000 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:03.472790 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:03.483830 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:03.494669 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:03.505430 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:03.516393 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:03.527286 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:03.640183 tst ping.py:19: start network... 04:24:03.840815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:04.301109 run create_hlr_db(pid=26073): Launched 04:24:04.413893 bus /gobi_6: Setting Powered False 04:24:05.473793 run create_hlr_db(pid=26073): Terminated: ok {rc=0} 04:24:05.906697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26075): Launched 04:24:06.223258 run osmo-hlr_10.42.42.2(pid=26076): Launched 04:24:06.344388 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:06.894236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26078): Launched 04:24:07.211027 run osmo-stp_10.42.42.5(pid=26079): Launched 04:24:07.331840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:07.882996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26081): Launched 04:24:08.004136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:08.272619 run patchelf(pid=26082): Launched 04:24:08.449563 run osmo-stp_10.42.42.5(pid=26079): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26079)] 04:24:08.584446 run osmo-stp_10.42.42.5(pid=26079): stdout: | (launched: 2022-12-10_04:24:07.153144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:08.720705 run osmo-stp_10.42.42.5(pid=26079): stderr: | 20221210042407346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042407346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042407346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042407347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042407347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042407347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042407347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:08.857061 run osmo-stp_10.42.42.5(pid=26079): stdout: | (launched: 2022-12-10_04:24:07.153144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:08.987089 run osmo-stp_10.42.42.5(pid=26079): stderr: | 20221210042407346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042407346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042407346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042407347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042407347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042407347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042407347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:09.141641 run patchelf(pid=26082): Terminating (SIGINT) 04:24:09.319536 run patchelf(pid=26082): Terminated: ok {rc=0} 04:24:09.447739 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26079): Process ended prematurely: osmo-stp_10.42.42.5(pid=26079) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26079)] [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 04:24:09.457487 tst ping.py:22: Test FAILED (6.6 sec) 04:24:09.485617 run osmo-hlr_10.42.42.2(pid=26076): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26076)] 04:24:09.535365 run osmo-hlr_10.42.42.2(pid=26076): stdout: | (launched: 2022-12-10_04:24:06.165563) 04:24:09.586877 run osmo-hlr_10.42.42.2(pid=26076): stderr: | 20221210042406362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042406362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042406362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042406362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042406362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042406362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042406377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042406387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042406387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042406387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:09.639274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26075): Terminating (SIGTERM) 04:24:09.680850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26078): Terminating (SIGTERM) 04:24:09.722991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26081): Terminating (SIGTERM) 04:24:09.765290 --- ParallelTerminationStrategy: PID 26075 died... 04:24:09.785441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26075): Terminated: ok {rc=0} 04:24:09.832047 --- ParallelTerminationStrategy: PID 26078 died... 04:24:09.851644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26078): Terminated: ok {rc=0} 04:24:09.898060 --- ParallelTerminationStrategy: PID 26081 died... 04:24:09.917892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26081): Terminated: ok {rc=0} 04:24:10.005170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:24:11.092744 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.104395 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:11.156352 tst ping_idle_ping.py: using LAC 25968 04:24:11.276063 tst ping_idle_ping.py: using RAC 213 04:24:11.393131 tst ping_idle_ping.py: using CellId 25968 04:24:11.512239 tst ping_idle_ping.py: using BVCI 25969 04:24:11.620249 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.631194 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.641905 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.652826 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.663630 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.674584 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.685720 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:11.696478 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:11.808877 tst ping_idle_ping.py:24: start network... 04:24:12.009267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:12.473250 run create_hlr_db(pid=26083): Launched 04:24:12.587756 bus /gobi_6: Setting Powered False 04:24:13.647469 run create_hlr_db(pid=26083): Terminated: ok {rc=0} 04:24:14.085743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26085): Launched 04:24:14.384148 run osmo-hlr_10.42.42.2(pid=26086): Launched 04:24:14.498601 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:15.011872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26088): Launched 04:24:15.310398 run osmo-stp_10.42.42.5(pid=26089): Launched 04:24:15.424141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:15.969757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26091): Launched 04:24:16.146894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:16.418019 run patchelf(pid=26092): Launched 04:24:16.604123 run osmo-stp_10.42.42.5(pid=26089): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26089)] 04:24:16.748851 run osmo-stp_10.42.42.5(pid=26089): stdout: | (launched: 2022-12-10_04:24:15.255452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:16.905835 run osmo-stp_10.42.42.5(pid=26089): stderr: | 20221210042415423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042415424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042415424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042415424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042415425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042415425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042415425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:17.045718 run osmo-stp_10.42.42.5(pid=26089): stdout: | (launched: 2022-12-10_04:24:15.255452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:17.180490 run osmo-stp_10.42.42.5(pid=26089): stderr: | 20221210042415423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042415424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042415424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042415424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042415425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042415425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042415425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:17.337668 run patchelf(pid=26092): Terminating (SIGINT) 04:24:17.515660 run patchelf(pid=26092): Terminated: ok {rc=0} 04:24:17.644518 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26089): Process ended prematurely: osmo-stp_10.42.42.5(pid=26089) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26089)] [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 04:24:17.654372 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:24:17.682842 run osmo-hlr_10.42.42.2(pid=26086): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26086)] 04:24:17.732677 run osmo-hlr_10.42.42.2(pid=26086): stdout: | (launched: 2022-12-10_04:24:14.329464) 04:24:17.784146 run osmo-hlr_10.42.42.2(pid=26086): stderr: | 20221210042414507 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042414507 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042414507 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042414507 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042414507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042414507 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042414519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042414530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042414530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042414530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:17.836018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26085): Terminating (SIGTERM) 04:24:17.877719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26088): Terminating (SIGTERM) 04:24:17.919612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26091): Terminating (SIGTERM) 04:24:17.961788 --- ParallelTerminationStrategy: PID 26085 died... 04:24:17.981996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26085): Terminated: ok {rc=0} 04:24:18.028391 --- ParallelTerminationStrategy: PID 26088 died... 04:24:18.048040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26088): Terminated: ok {rc=0} 04:24:18.094965 --- ParallelTerminationStrategy: PID 26091 died... 04:24:18.114865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26091): Terminated: ok {rc=0} 04:24:18.202902 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:24:19.506720 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:24:19.513231 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:24:19.546766 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:24:19.586210 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:24:19.674360 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:24:19.708193 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:24:19.747582 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:24:20.342875 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:24:20.394813 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:20.406155 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:24:20.478420 tst cs_paging_gprs_active.py: using LAC 25969 04:24:20.605431 tst cs_paging_gprs_active.py: using RAC 214 04:24:20.727094 tst cs_paging_gprs_active.py: using CellId 25969 04:24:20.850489 tst cs_paging_gprs_active.py: using BVCI 25970 04:24:20.961903 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:20.972853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:20.983527 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:20.994606 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:21.005515 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:21.016384 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:21.027358 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:21.038482 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:21.049499 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:24:21.168212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:24:21.287761 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:24:21.507789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:21.833940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Launched 04:24:22.114435 run iperf3-srv_10.42.42.10(pid=26097): Launched 04:24:22.235560 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:24:22.453706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:22.778005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Launched 04:24:23.057651 run iperf3-srv_10.42.42.10(pid=26099): Launched 04:24:23.178407 tst cs_paging_gprs_active.py:38: start network... 04:24:23.395974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:23.894736 run create_hlr_db(pid=26100): Launched 04:24:24.025832 bus /gobi_6: Setting Powered False 04:24:25.089905 run create_hlr_db(pid=26100): Terminated: ok {rc=0} 04:24:25.537725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26102): Launched 04:24:25.858524 run osmo-hlr_10.42.42.2(pid=26103): Launched 04:24:25.981364 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:26.536602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26105): Launched 04:24:26.857717 run osmo-stp_10.42.42.5(pid=26106): Launched 04:24:26.980921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:27.536880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26108): Launched 04:24:27.659391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:27.937580 run patchelf(pid=26109): Launched 04:24:28.117296 run osmo-stp_10.42.42.5(pid=26106): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26106)] 04:24:28.253719 run osmo-stp_10.42.42.5(pid=26106): stdout: | (launched: 2022-12-10_04:24:26.798937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:28.392150 run osmo-stp_10.42.42.5(pid=26106): stderr: | 20221210042426994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042426994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042426994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042426995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042426995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042426995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042426995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:28.530631 run osmo-stp_10.42.42.5(pid=26106): stdout: | (launched: 2022-12-10_04:24:26.798937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:28.662158 run osmo-stp_10.42.42.5(pid=26106): stderr: | 20221210042426994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042426994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042426994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042426995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042426995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042426995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042426995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:28.819164 run patchelf(pid=26109): Terminating (SIGINT) 04:24:29.000100 run patchelf(pid=26109): Terminated: ok {rc=0} 04:24:29.130999 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26106): Process ended prematurely: osmo-stp_10.42.42.5(pid=26106) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26106)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:24:29.141286 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:24:29.170000 run osmo-hlr_10.42.42.2(pid=26103): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26103)] 04:24:29.219787 run osmo-hlr_10.42.42.2(pid=26103): stdout: | (launched: 2022-12-10_04:24:25.799885) 04:24:29.270990 run osmo-hlr_10.42.42.2(pid=26103): stderr: | 20221210042425999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042425999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042425999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042425999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042425999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042425999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042426013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042426021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042426021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042426021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:29.322544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Terminating (SIGTERM) 04:24:29.363867 run iperf3-srv_10.42.42.10(pid=26097): Terminating (SIGTERM) 04:24:29.405378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Terminating (SIGTERM) 04:24:29.446830 run iperf3-srv_10.42.42.10(pid=26099): Terminating (SIGTERM) 04:24:29.487968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26102): Terminating (SIGTERM) 04:24:29.529182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26105): Terminating (SIGTERM) 04:24:29.570315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26108): Terminating (SIGTERM) 04:24:29.611764 --- ParallelTerminationStrategy: PID 26096 died... 04:24:29.631640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26096): Terminated: ok {rc=0} 04:24:29.677496 --- ParallelTerminationStrategy: PID 26097 died... 04:24:29.696813 run iperf3-srv_10.42.42.10(pid=26097): Terminated {rc=256} 04:24:29.742386 --- ParallelTerminationStrategy: PID 26098 died... 04:24:29.761712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26098): Terminated: ok {rc=0} 04:24:29.807318 --- ParallelTerminationStrategy: PID 26099 died... 04:24:29.826668 run iperf3-srv_10.42.42.10(pid=26099): Terminated {rc=256} 04:24:29.872046 --- ParallelTerminationStrategy: PID 26102 died... 04:24:29.891426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26102): Terminated: ok {rc=0} 04:24:29.936797 --- ParallelTerminationStrategy: PID 26105 died... 04:24:29.956507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26105): Terminated: ok {rc=0} 04:24:30.002032 --- ParallelTerminationStrategy: PID 26108 died... 04:24:30.021419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26108): Terminated: ok {rc=0} 04:24:30.108615 bus /gobi_0: Setting Powered False 04:24:31.201943 bus /gobi_0: Setting Powered False 04:24:32.314449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:24:33.461706 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:33.473603 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:24:33.546319 tst iperf3.py: using LAC 25970 04:24:33.677228 tst iperf3.py: using RAC 215 04:24:33.802899 tst iperf3.py: using CellId 25970 04:24:33.926731 tst iperf3.py: using BVCI 25971 04:24:34.045052 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.056445 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.067625 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.078844 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.090464 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.101701 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.113063 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.124067 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:34.135445 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:24:34.253190 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:24:34.472002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:34.796158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26110): Launched 04:24:35.077487 run iperf3-srv_10.42.42.10(pid=26111): Launched 04:24:35.198410 tst iperf3.py:8: start network... 04:24:35.416642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:35.914120 run create_hlr_db(pid=26112): Launched 04:24:36.044055 bus /gobi_6: Setting Powered False 04:24:37.108900 run create_hlr_db(pid=26112): Terminated: ok {rc=0} 04:24:37.555752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26114): Launched 04:24:37.877563 run osmo-hlr_10.42.42.2(pid=26115): Launched 04:24:38.000533 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:38.559093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26117): Launched 04:24:38.881712 run osmo-stp_10.42.42.5(pid=26118): Launched 04:24:39.004382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:39.559325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26120): Launched 04:24:39.683152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:39.955437 run patchelf(pid=26121): Launched 04:24:40.134545 run osmo-stp_10.42.42.5(pid=26118): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26118)] 04:24:40.271115 run osmo-stp_10.42.42.5(pid=26118): stdout: | (launched: 2022-12-10_04:24:38.822792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:40.409477 run osmo-stp_10.42.42.5(pid=26118): stderr: | 20221210042439015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042439016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042439016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042439016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042439017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042439017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042439017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:40.547865 run osmo-stp_10.42.42.5(pid=26118): stdout: | (launched: 2022-12-10_04:24:38.822792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:40.679851 run osmo-stp_10.42.42.5(pid=26118): stderr: | 20221210042439015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042439016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042439016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042439016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042439017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042439017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042439017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:40.837128 run patchelf(pid=26121): Terminating (SIGINT) 04:24:41.017768 run patchelf(pid=26121): Terminated: ok {rc=0} 04:24:41.148730 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26118): Process ended prematurely: osmo-stp_10.42.42.5(pid=26118) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26118)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 04:24:41.159087 tst iperf3.py:8: Test FAILED (7.7 sec) 04:24:41.187794 run osmo-hlr_10.42.42.2(pid=26115): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26115)] 04:24:41.237415 run osmo-hlr_10.42.42.2(pid=26115): stdout: | (launched: 2022-12-10_04:24:37.819168) 04:24:41.288562 run osmo-hlr_10.42.42.2(pid=26115): stderr: | 20221210042438018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042438018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042438018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042438018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042438018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042438018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042438031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042438039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042438040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042438040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:41.340258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26110): Terminating (SIGTERM) 04:24:41.381869 run iperf3-srv_10.42.42.10(pid=26111): Terminating (SIGTERM) 04:24:41.423255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26114): Terminating (SIGTERM) 04:24:41.464584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26117): Terminating (SIGTERM) 04:24:41.505872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26120): Terminating (SIGTERM) 04:24:41.547505 --- ParallelTerminationStrategy: PID 26110 died... 04:24:41.567511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26110): Terminated: ok {rc=0} 04:24:41.613852 --- ParallelTerminationStrategy: PID 26111 died... 04:24:41.633227 run iperf3-srv_10.42.42.10(pid=26111): Terminated {rc=256} 04:24:41.678907 --- ParallelTerminationStrategy: PID 26114 died... 04:24:41.698388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26114): Terminated: ok {rc=0} 04:24:41.744205 --- ParallelTerminationStrategy: PID 26117 died... 04:24:41.763642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26117): Terminated: ok {rc=0} 04:24:41.809468 --- ParallelTerminationStrategy: PID 26120 died... 04:24:41.828996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26120): Terminated: ok {rc=0} 04:24:41.915697 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:24:43.066307 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.078266 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:24:43.148418 tst iperf3m4.py: using LAC 25971 04:24:43.273164 tst iperf3m4.py: using RAC 216 04:24:43.397718 tst iperf3m4.py: using CellId 25971 04:24:43.516560 tst iperf3m4.py: using BVCI 25972 04:24:43.627139 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.638044 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.648791 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.660387 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.671825 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.683242 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.694901 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.706179 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:24:43.717742 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:24:43.833529 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:24:43.954879 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:24:44.071101 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:24:44.186796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:24:44.391168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:44.695763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26122): Launched 04:24:44.960739 run iperf3-srv_10.42.42.10(pid=26123): Launched 04:24:45.074382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:24:45.278465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:45.583424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26124): Launched 04:24:45.853725 run iperf3-srv_10.42.42.10(pid=26125): Launched 04:24:45.983135 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:24:46.191046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:46.505612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26126): Launched 04:24:46.788313 run iperf3-srv_10.42.42.10(pid=26127): Launched 04:24:46.935385 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:24:47.142734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:47.449360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26128): Launched 04:24:47.712813 run iperf3-srv_10.42.42.10(pid=26129): Launched 04:24:47.826164 tst iperf3m4.py:8: start network... 04:24:48.029116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:48.497586 run create_hlr_db(pid=26130): Launched 04:24:48.612612 bus /gobi_6: Setting Powered False 04:24:49.672043 run create_hlr_db(pid=26130): Terminated: ok {rc=0} 04:24:50.092861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26132): Launched 04:24:50.394723 run osmo-hlr_10.42.42.2(pid=26133): Launched 04:24:50.509758 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:51.028855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26135): Launched 04:24:51.352574 run osmo-stp_10.42.42.5(pid=26136): Launched 04:24:51.475308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:52.030868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26138): Launched 04:24:52.154447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:52.425548 run patchelf(pid=26139): Launched 04:24:52.603411 run osmo-stp_10.42.42.5(pid=26136): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26136)] 04:24:52.739578 run osmo-stp_10.42.42.5(pid=26136): stdout: | (launched: 2022-12-10_04:24:51.293735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:52.877534 run osmo-stp_10.42.42.5(pid=26136): stderr: | 20221210042451487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042451487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042451487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042451488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042451488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042451488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042451488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:53.015921 run osmo-stp_10.42.42.5(pid=26136): stdout: | (launched: 2022-12-10_04:24:51.293735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:53.147979 run osmo-stp_10.42.42.5(pid=26136): stderr: | 20221210042451487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042451487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042451487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042451488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042451488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042451488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042451488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:53.303871 run patchelf(pid=26139): Terminating (SIGINT) 04:24:53.484071 run patchelf(pid=26139): Terminated: ok {rc=0} 04:24:53.614185 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26136): Process ended prematurely: osmo-stp_10.42.42.5(pid=26136) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26136)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:24:53.624486 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:24:53.653562 run osmo-hlr_10.42.42.2(pid=26133): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26133)] 04:24:53.702826 run osmo-hlr_10.42.42.2(pid=26133): stdout: | (launched: 2022-12-10_04:24:50.339016) 04:24:53.753677 run osmo-hlr_10.42.42.2(pid=26133): stderr: | 20221210042450516 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042450516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042450516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042450516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042450516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042450516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042450529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042450537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042450538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042450538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:53.805089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26122): Terminating (SIGTERM) 04:24:53.846566 run iperf3-srv_10.42.42.10(pid=26123): Terminating (SIGTERM) 04:24:53.888331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26124): Terminating (SIGTERM) 04:24:53.929907 run iperf3-srv_10.42.42.10(pid=26125): Terminating (SIGTERM) 04:24:53.971268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26126): Terminating (SIGTERM) 04:24:54.012753 run iperf3-srv_10.42.42.10(pid=26127): Terminating (SIGTERM) 04:24:54.054232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26128): Terminating (SIGTERM) 04:24:54.096050 run iperf3-srv_10.42.42.10(pid=26129): Terminating (SIGTERM) 04:24:54.137593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26132): Terminating (SIGTERM) 04:24:54.179253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26135): Terminating (SIGTERM) 04:24:54.220745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26138): Terminating (SIGTERM) 04:24:54.262978 --- ParallelTerminationStrategy: PID 26122 died... 04:24:54.283098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26122): Terminated: ok {rc=0} 04:24:54.329593 --- ParallelTerminationStrategy: PID 26123 died... 04:24:54.349137 run iperf3-srv_10.42.42.10(pid=26123): Terminated {rc=256} 04:24:54.395614 --- ParallelTerminationStrategy: PID 26124 died... 04:24:54.415172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26124): Terminated: ok {rc=0} 04:24:54.461232 --- ParallelTerminationStrategy: PID 26125 died... 04:24:54.480687 run iperf3-srv_10.42.42.10(pid=26125): Terminated {rc=256} 04:24:54.526770 --- ParallelTerminationStrategy: PID 26126 died... 04:24:54.546349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26126): Terminated: ok {rc=0} 04:24:54.592574 --- ParallelTerminationStrategy: PID 26127 died... 04:24:54.612148 run iperf3-srv_10.42.42.10(pid=26127): Terminated {rc=256} 04:24:54.658154 --- ParallelTerminationStrategy: PID 26128 died... 04:24:54.677741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26128): Terminated: ok {rc=0} 04:24:54.723826 --- ParallelTerminationStrategy: PID 26129 died... 04:24:54.743436 run iperf3-srv_10.42.42.10(pid=26129): Terminated {rc=256} 04:24:54.789421 --- ParallelTerminationStrategy: PID 26132 died... 04:24:54.808942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26132): Terminated: ok {rc=0} 04:24:54.855135 --- ParallelTerminationStrategy: PID 26135 died... 04:24:54.874714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26135): Terminated: ok {rc=0} 04:24:54.920923 --- ParallelTerminationStrategy: PID 26138 died... 04:24:54.940934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26138): Terminated: ok {rc=0} 04:24:55.028908 bus /gobi_4: Setting Powered False 04:24:56.129234 bus /gobi_4: Setting Powered False 04:24:57.248269 bus /gobi_1: Setting Powered False 04:24:58.346052 bus /gobi_1: Setting Powered False 04:24:59.462774 bus /gobi_0: Setting Powered False 04:25:00.560836 bus /gobi_0: Setting Powered False 04:25:01.674567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:25:02.780638 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:02.792759 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:02.869345 tst ping.py: using LAC 25972 04:25:02.991455 tst ping.py: using RAC 217 04:25:03.107017 tst ping.py: using CellId 25972 04:25:03.221809 tst ping.py: using BVCI 25973 04:25:03.331114 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:03.342191 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:03.353072 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:03.363919 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:03.374948 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:03.386176 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:03.397360 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:03.408251 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:03.526391 tst ping.py:19: start network... 04:25:03.726354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:04.187485 run create_hlr_db(pid=26143): Launched 04:25:04.301171 bus /gobi_6: Setting Powered False 04:25:05.360003 run create_hlr_db(pid=26143): Terminated: ok {rc=0} 04:25:05.774034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Launched 04:25:06.070642 run osmo-hlr_10.42.42.2(pid=26146): Launched 04:25:06.184037 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:06.697989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Launched 04:25:06.995158 run osmo-stp_10.42.42.5(pid=26149): Launched 04:25:07.109437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:07.622139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Launched 04:25:07.735544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:07.986022 run patchelf(pid=26152): Launched 04:25:08.151463 run osmo-stp_10.42.42.5(pid=26149): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] 04:25:08.277505 run osmo-stp_10.42.42.5(pid=26149): stdout: | (launched: 2022-12-10_04:25:06.940412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:08.404698 run osmo-stp_10.42.42.5(pid=26149): stderr: | 20221210042507111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042507111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042507111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042507112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042507112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042507112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042507112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:08.532109 run osmo-stp_10.42.42.5(pid=26149): stdout: | (launched: 2022-12-10_04:25:06.940412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:08.653819 run osmo-stp_10.42.42.5(pid=26149): stderr: | 20221210042507111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042507111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042507111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042507112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042507112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042507112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042507112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:08.798216 run patchelf(pid=26152): Terminating (SIGINT) 04:25:08.965090 run patchelf(pid=26152): Terminated: ok {rc=0} 04:25:09.085470 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26149): Process ended prematurely: osmo-stp_10.42.42.5(pid=26149) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 04:25:09.094525 tst ping.py:22: Test FAILED (6.3 sec) 04:25:09.122104 run osmo-hlr_10.42.42.2(pid=26146): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26146)] 04:25:09.169893 run osmo-hlr_10.42.42.2(pid=26146): stdout: | (launched: 2022-12-10_04:25:06.015937) 04:25:09.219365 run osmo-hlr_10.42.42.2(pid=26146): stderr: | 20221210042506193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042506193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042506193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042506193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042506193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042506193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042506205 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042506213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042506213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042506213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:09.269494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminating (SIGTERM) 04:25:09.309676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Terminating (SIGTERM) 04:25:09.349946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Terminating (SIGTERM) 04:25:09.390341 --- ParallelTerminationStrategy: PID 26145 died... 04:25:09.409546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26145): Terminated: ok {rc=0} 04:25:09.454399 --- ParallelTerminationStrategy: PID 26148 died... 04:25:09.473145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26148): Terminated: ok {rc=0} 04:25:09.517640 --- ParallelTerminationStrategy: PID 26151 died... 04:25:09.536509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26151): Terminated: ok {rc=0} 04:25:09.622412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:25:10.709376 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:10.720942 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:10.791803 tst ping_idle_ping.py: using LAC 25973 04:25:10.911021 tst ping_idle_ping.py: using RAC 218 04:25:11.032884 tst ping_idle_ping.py: using CellId 25973 04:25:11.148786 tst ping_idle_ping.py: using BVCI 25974 04:25:11.265610 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:11.276937 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:11.288132 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:11.299371 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:11.311110 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:11.322376 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:11.333671 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:11.344734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:11.465364 tst ping_idle_ping.py:24: start network... 04:25:11.679866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:12.175085 run create_hlr_db(pid=26154): Launched 04:25:12.303402 bus /gobi_6: Setting Powered False 04:25:13.366669 run create_hlr_db(pid=26154): Terminated: ok {rc=0} 04:25:13.793165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Launched 04:25:14.092236 run osmo-hlr_10.42.42.2(pid=26157): Launched 04:25:14.205637 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:14.718054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Launched 04:25:15.015062 run osmo-stp_10.42.42.5(pid=26160): Launched 04:25:15.129410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:15.644142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Launched 04:25:15.758181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:16.045780 run patchelf(pid=26163): Launched 04:25:16.285606 run osmo-stp_10.42.42.5(pid=26160): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] 04:25:16.428211 run osmo-stp_10.42.42.5(pid=26160): stdout: | (launched: 2022-12-10_04:25:14.960426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:16.561651 run osmo-stp_10.42.42.5(pid=26160): stderr: | 20221210042515129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042515129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042515130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042515130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042515132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042515132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042515133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:16.693700 run osmo-stp_10.42.42.5(pid=26160): stdout: | (launched: 2022-12-10_04:25:14.960426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:16.820711 run osmo-stp_10.42.42.5(pid=26160): stderr: | 20221210042515129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042515129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042515130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042515130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042515132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042515132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042515133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:16.971203 run patchelf(pid=26163): Terminating (SIGINT) 04:25:17.143922 run patchelf(pid=26163): Terminated: ok {rc=0} 04:25:17.268339 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26160): Process ended prematurely: osmo-stp_10.42.42.5(pid=26160) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:25:17.278927 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:25:17.308176 run osmo-hlr_10.42.42.2(pid=26157): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26157)] 04:25:17.356688 run osmo-hlr_10.42.42.2(pid=26157): stdout: | (launched: 2022-12-10_04:25:14.037629) 04:25:17.406720 run osmo-hlr_10.42.42.2(pid=26157): stderr: | 20221210042514216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042514216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042514216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042514216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042514216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042514216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042514228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042514236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042514236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042514237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:17.457609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Terminating (SIGTERM) 04:25:17.498479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Terminating (SIGTERM) 04:25:17.538955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Terminating (SIGTERM) 04:25:17.579804 --- ParallelTerminationStrategy: PID 26156 died... 04:25:17.599235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Terminated: ok {rc=0} 04:25:17.645250 --- ParallelTerminationStrategy: PID 26159 died... 04:25:17.663892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Terminated: ok {rc=0} 04:25:17.709958 --- ParallelTerminationStrategy: PID 26162 died... 04:25:17.728707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Terminated: ok {rc=0} 04:25:17.816635 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:25:19.117980 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:25:19.124205 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:25:19.157731 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:25:19.195867 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:25:19.280929 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:25:19.313627 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:25:19.351735 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:25:19.944770 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:25:19.994211 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.005245 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:25:20.078323 tst cs_paging_gprs_active.py: using LAC 25974 04:25:20.197681 tst cs_paging_gprs_active.py: using RAC 219 04:25:20.319534 tst cs_paging_gprs_active.py: using CellId 25974 04:25:20.438196 tst cs_paging_gprs_active.py: using BVCI 25975 04:25:20.548324 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.559255 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.569945 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.581241 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.592076 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.602892 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.613876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.624596 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:20.635638 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:25:20.750083 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:25:20.868787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:25:21.073447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:21.379204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26168): Launched 04:25:21.642988 run iperf3-srv_10.42.42.10(pid=26169): Launched 04:25:21.756483 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:25:21.959591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:22.263624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26170): Launched 04:25:22.527548 run iperf3-srv_10.42.42.10(pid=26171): Launched 04:25:22.641094 tst cs_paging_gprs_active.py:38: start network... 04:25:22.844137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:23.313557 run create_hlr_db(pid=26172): Launched 04:25:23.429084 bus /gobi_6: Setting Powered False 04:25:24.489201 run create_hlr_db(pid=26172): Terminated: ok {rc=0} 04:25:24.930068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26174): Launched 04:25:25.252851 run osmo-hlr_10.42.42.2(pid=26175): Launched 04:25:25.376571 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:25.931020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26177): Launched 04:25:26.253885 run osmo-stp_10.42.42.5(pid=26178): Launched 04:25:26.377378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:26.934035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26180): Launched 04:25:27.057417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:27.331387 run patchelf(pid=26181): Launched 04:25:27.512796 run osmo-stp_10.42.42.5(pid=26178): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26178)] 04:25:27.649607 run osmo-stp_10.42.42.5(pid=26178): stdout: | (launched: 2022-12-10_04:25:26.195071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:27.788251 run osmo-stp_10.42.42.5(pid=26178): stderr: | 20221210042526386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042526386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042526387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042526387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042526390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042526390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042526390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:27.927160 run osmo-stp_10.42.42.5(pid=26178): stdout: | (launched: 2022-12-10_04:25:26.195071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:28.059649 run osmo-stp_10.42.42.5(pid=26178): stderr: | 20221210042526386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042526386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042526387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042526387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042526390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042526390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042526390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:28.217212 run patchelf(pid=26181): Terminating (SIGINT) 04:25:28.398883 run patchelf(pid=26181): Terminated: ok {rc=0} 04:25:28.529530 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26178): Process ended prematurely: osmo-stp_10.42.42.5(pid=26178) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26178)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:25:28.539923 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:25:28.568443 run osmo-hlr_10.42.42.2(pid=26175): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26175)] 04:25:28.618020 run osmo-hlr_10.42.42.2(pid=26175): stdout: | (launched: 2022-12-10_04:25:25.193923) 04:25:28.669617 run osmo-hlr_10.42.42.2(pid=26175): stderr: | 20221210042525394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042525395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042525395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042525395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042525395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042525395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042525407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042525415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042525415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042525415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:28.721548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26168): Terminating (SIGTERM) 04:25:28.762898 run iperf3-srv_10.42.42.10(pid=26169): Terminating (SIGTERM) 04:25:28.804045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26170): Terminating (SIGTERM) 04:25:28.845355 run iperf3-srv_10.42.42.10(pid=26171): Terminating (SIGTERM) 04:25:28.886419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26174): Terminating (SIGTERM) 04:25:28.927559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26177): Terminating (SIGTERM) 04:25:28.968706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26180): Terminating (SIGTERM) 04:25:29.010244 --- ParallelTerminationStrategy: PID 26168 died... 04:25:29.030040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26168): Terminated: ok {rc=0} 04:25:29.076144 --- ParallelTerminationStrategy: PID 26169 died... 04:25:29.095598 run iperf3-srv_10.42.42.10(pid=26169): Terminated {rc=256} 04:25:29.141687 --- ParallelTerminationStrategy: PID 26170 died... 04:25:29.161355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26170): Terminated: ok {rc=0} 04:25:29.207027 --- ParallelTerminationStrategy: PID 26171 died... 04:25:29.226597 run iperf3-srv_10.42.42.10(pid=26171): Terminated {rc=256} 04:25:29.271985 --- ParallelTerminationStrategy: PID 26174 died... 04:25:29.291346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26174): Terminated: ok {rc=0} 04:25:29.336726 --- ParallelTerminationStrategy: PID 26177 died... 04:25:29.356020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26177): Terminated: ok {rc=0} 04:25:29.401382 --- ParallelTerminationStrategy: PID 26180 died... 04:25:29.420684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26180): Terminated: ok {rc=0} 04:25:29.506989 bus /gobi_0: Setting Powered False 04:25:30.604810 bus /gobi_0: Setting Powered False 04:25:31.720429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:25:32.864722 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:32.876358 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:25:32.946855 tst iperf3.py: using LAC 25975 04:25:33.065364 tst iperf3.py: using RAC 220 04:25:33.186239 tst iperf3.py: using CellId 25975 04:25:33.306576 tst iperf3.py: using BVCI 25976 04:25:33.418599 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.429571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.440334 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.451360 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.462237 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.473171 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.484780 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.495703 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:33.506880 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:25:33.623102 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:25:33.841723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:34.165369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26182): Launched 04:25:34.445444 run iperf3-srv_10.42.42.10(pid=26183): Launched 04:25:34.565796 tst iperf3.py:8: start network... 04:25:34.783513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:35.284511 run create_hlr_db(pid=26184): Launched 04:25:35.416122 bus /gobi_6: Setting Powered False 04:25:36.480896 run create_hlr_db(pid=26184): Terminated: ok {rc=0} 04:25:36.913489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26186): Launched 04:25:37.216572 run osmo-hlr_10.42.42.2(pid=26187): Launched 04:25:37.332637 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:37.869184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26189): Launched 04:25:38.171820 run osmo-stp_10.42.42.5(pid=26190): Launched 04:25:38.286609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:38.807711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26192): Launched 04:25:38.924092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:39.179760 run patchelf(pid=26193): Launched 04:25:39.348277 run osmo-stp_10.42.42.5(pid=26190): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26190)] 04:25:39.477197 run osmo-stp_10.42.42.5(pid=26190): stdout: | (launched: 2022-12-10_04:25:38.116284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:39.607302 run osmo-stp_10.42.42.5(pid=26190): stderr: | 20221210042538288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042538288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042538288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042538289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042538289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042538289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042538289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:39.737676 run osmo-stp_10.42.42.5(pid=26190): stdout: | (launched: 2022-12-10_04:25:38.116284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:39.861750 run osmo-stp_10.42.42.5(pid=26190): stderr: | 20221210042538288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042538288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042538288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042538289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042538289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042538289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042538289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:40.010243 run patchelf(pid=26193): Terminating (SIGINT) 04:25:40.180447 run patchelf(pid=26193): Terminated: ok {rc=0} 04:25:40.303122 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26190): Process ended prematurely: osmo-stp_10.42.42.5(pid=26190) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26190)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 04:25:40.312695 tst iperf3.py:8: Test FAILED (7.5 sec) 04:25:40.341087 run osmo-hlr_10.42.42.2(pid=26187): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26187)] 04:25:40.388723 run osmo-hlr_10.42.42.2(pid=26187): stdout: | (launched: 2022-12-10_04:25:37.160925) 04:25:40.438207 run osmo-hlr_10.42.42.2(pid=26187): stderr: | 20221210042537340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042537340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042537340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042537340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042537340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042537340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042537351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042537360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042537360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042537361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:40.488137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26182): Terminating (SIGTERM) 04:25:40.527848 run iperf3-srv_10.42.42.10(pid=26183): Terminating (SIGTERM) 04:25:40.567624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26186): Terminating (SIGTERM) 04:25:40.607388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26189): Terminating (SIGTERM) 04:25:40.647107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26192): Terminating (SIGTERM) 04:25:40.687185 --- ParallelTerminationStrategy: PID 26182 died... 04:25:40.705855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26182): Terminated: ok {rc=0} 04:25:40.750090 --- ParallelTerminationStrategy: PID 26183 died... 04:25:40.768552 run iperf3-srv_10.42.42.10(pid=26183): Terminated {rc=256} 04:25:40.812643 --- ParallelTerminationStrategy: PID 26186 died... 04:25:40.831389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26186): Terminated: ok {rc=0} 04:25:40.875593 --- ParallelTerminationStrategy: PID 26189 died... 04:25:40.894178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26189): Terminated: ok {rc=0} 04:25:40.938059 --- ParallelTerminationStrategy: PID 26192 died... 04:25:40.956660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26192): Terminated: ok {rc=0} 04:25:41.042612 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:25:42.194564 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.206519 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:25:42.278516 tst iperf3m4.py: using LAC 25976 04:25:42.406590 tst iperf3m4.py: using RAC 221 04:25:42.534194 tst iperf3m4.py: using CellId 25976 04:25:42.659990 tst iperf3m4.py: using BVCI 25977 04:25:42.776891 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.788388 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.799586 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.810728 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.821795 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.832855 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.844163 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.855195 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:25:42.866472 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:25:42.984196 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:25:43.107386 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:25:43.222282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:25:43.341351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:25:43.546466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:43.852384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26194): Launched 04:25:44.117952 run iperf3-srv_10.42.42.10(pid=26195): Launched 04:25:44.231647 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:25:44.435079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:44.739199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26196): Launched 04:25:45.003621 run iperf3-srv_10.42.42.10(pid=26197): Launched 04:25:45.117582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:25:45.321154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:45.626080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26198): Launched 04:25:45.893168 run iperf3-srv_10.42.42.10(pid=26199): Launched 04:25:46.022612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:25:46.230218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:46.541885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26200): Launched 04:25:46.824103 run iperf3-srv_10.42.42.10(pid=26201): Launched 04:25:46.950496 tst iperf3m4.py:8: start network... 04:25:47.160450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:47.634295 run create_hlr_db(pid=26202): Launched 04:25:47.751567 bus /gobi_6: Setting Powered False 04:25:48.811921 run create_hlr_db(pid=26202): Terminated: ok {rc=0} 04:25:49.254167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26204): Launched 04:25:49.577616 run osmo-hlr_10.42.42.2(pid=26205): Launched 04:25:49.701668 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:50.260628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26207): Launched 04:25:50.583750 run osmo-stp_10.42.42.5(pid=26208): Launched 04:25:50.706581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:51.263377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26210): Launched 04:25:51.387855 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:51.660604 run patchelf(pid=26211): Launched 04:25:51.838962 run osmo-stp_10.42.42.5(pid=26208): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26208)] 04:25:51.975345 run osmo-stp_10.42.42.5(pid=26208): stdout: | (launched: 2022-12-10_04:25:50.524388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:52.113745 run osmo-stp_10.42.42.5(pid=26208): stderr: | 20221210042550718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042550718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042550718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042550719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042550719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042550719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042550719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:52.252076 run osmo-stp_10.42.42.5(pid=26208): stdout: | (launched: 2022-12-10_04:25:50.524388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:52.383952 run osmo-stp_10.42.42.5(pid=26208): stderr: | 20221210042550718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042550718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042550718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042550719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042550719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042550719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042550719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:52.540204 run patchelf(pid=26211): Terminating (SIGINT) 04:25:52.720939 run patchelf(pid=26211): Terminated: ok {rc=0} 04:25:52.851236 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26208): Process ended prematurely: osmo-stp_10.42.42.5(pid=26208) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26208)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:25:52.861673 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:25:52.890761 run osmo-hlr_10.42.42.2(pid=26205): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26205)] 04:25:52.940665 run osmo-hlr_10.42.42.2(pid=26205): stdout: | (launched: 2022-12-10_04:25:49.518712) 04:25:52.992376 run osmo-hlr_10.42.42.2(pid=26205): stderr: | 20221210042549720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042549720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042549720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042549720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042549720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042549720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042549732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042549740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042549740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042549741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:53.044381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26194): Terminating (SIGTERM) 04:25:53.086310 run iperf3-srv_10.42.42.10(pid=26195): Terminating (SIGTERM) 04:25:53.128566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26196): Terminating (SIGTERM) 04:25:53.171292 run iperf3-srv_10.42.42.10(pid=26197): Terminating (SIGTERM) 04:25:53.213053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26198): Terminating (SIGTERM) 04:25:53.254903 run iperf3-srv_10.42.42.10(pid=26199): Terminating (SIGTERM) 04:25:53.296286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26200): Terminating (SIGTERM) 04:25:53.338088 run iperf3-srv_10.42.42.10(pid=26201): Terminating (SIGTERM) 04:25:53.379681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26204): Terminating (SIGTERM) 04:25:53.421891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26207): Terminating (SIGTERM) 04:25:53.463597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26210): Terminating (SIGTERM) 04:25:53.505682 --- ParallelTerminationStrategy: PID 26194 died... 04:25:53.525743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26194): Terminated: ok {rc=0} 04:25:53.572070 --- ParallelTerminationStrategy: PID 26195 died... 04:25:53.591603 run iperf3-srv_10.42.42.10(pid=26195): Terminated {rc=256} 04:25:53.637600 --- ParallelTerminationStrategy: PID 26196 died... 04:25:53.657322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26196): Terminated: ok {rc=0} 04:25:53.703544 --- ParallelTerminationStrategy: PID 26197 died... 04:25:53.723113 run iperf3-srv_10.42.42.10(pid=26197): Terminated {rc=256} 04:25:53.769033 --- ParallelTerminationStrategy: PID 26198 died... 04:25:53.788487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26198): Terminated: ok {rc=0} 04:25:53.834380 --- ParallelTerminationStrategy: PID 26199 died... 04:25:53.853926 run iperf3-srv_10.42.42.10(pid=26199): Terminated {rc=256} 04:25:53.899786 --- ParallelTerminationStrategy: PID 26200 died... 04:25:53.919254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26200): Terminated: ok {rc=0} 04:25:53.965486 --- ParallelTerminationStrategy: PID 26201 died... 04:25:53.984936 run iperf3-srv_10.42.42.10(pid=26201): Terminated {rc=256} 04:25:54.030820 --- ParallelTerminationStrategy: PID 26204 died... 04:25:54.050366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26204): Terminated: ok {rc=0} 04:25:54.095631 --- ParallelTerminationStrategy: PID 26207 died... 04:25:54.115002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26207): Terminated: ok {rc=0} 04:25:54.160751 --- ParallelTerminationStrategy: PID 26210 died... 04:25:54.180207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26210): Terminated: ok {rc=0} 04:25:54.266706 bus /gobi_4: Setting Powered False 04:25:55.364826 bus /gobi_4: Setting Powered False 04:25:56.481469 bus /gobi_1: Setting Powered False 04:25:57.579970 bus /gobi_1: Setting Powered False 04:25:58.695078 bus /gobi_0: Setting Powered False 04:25:59.794954 bus /gobi_0: Setting Powered False 04:26:00.919027 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:26:02.044697 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.061824 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:02.152562 tst ping.py: using LAC 25977 04:26:02.291251 tst ping.py: using RAC 222 04:26:02.415552 tst ping.py: using CellId 25977 04:26:02.538897 tst ping.py: using BVCI 25978 04:26:02.653894 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.665466 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.676647 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.687871 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.698987 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.710193 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.721496 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:02.732610 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:02.845670 tst ping.py:19: start network... 04:26:03.046772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:03.509472 run create_hlr_db(pid=26212): Launched 04:26:03.624629 bus /gobi_6: Setting Powered False 04:26:04.684406 run create_hlr_db(pid=26212): Terminated: ok {rc=0} 04:26:05.120163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26214): Launched 04:26:05.439140 run osmo-hlr_10.42.42.2(pid=26215): Launched 04:26:05.561666 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:06.115173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26217): Launched 04:26:06.432584 run osmo-stp_10.42.42.5(pid=26218): Launched 04:26:06.554088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:07.102196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26220): Launched 04:26:07.223273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:07.491223 run patchelf(pid=26221): Launched 04:26:07.667362 run osmo-stp_10.42.42.5(pid=26218): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26218)] 04:26:07.801325 run osmo-stp_10.42.42.5(pid=26218): stdout: | (launched: 2022-12-10_04:26:06.374343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:07.936838 run osmo-stp_10.42.42.5(pid=26218): stderr: | 20221210042606566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042606566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042606566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042606567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042606569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042606569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042606569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:08.072788 run osmo-stp_10.42.42.5(pid=26218): stdout: | (launched: 2022-12-10_04:26:06.374343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:08.203084 run osmo-stp_10.42.42.5(pid=26218): stderr: | 20221210042606566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042606566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042606566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042606567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042606569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042606569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042606569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:08.356817 run patchelf(pid=26221): Terminating (SIGINT) 04:26:08.534289 run patchelf(pid=26221): Terminated: ok {rc=0} 04:26:08.662300 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26218): Process ended prematurely: osmo-stp_10.42.42.5(pid=26218) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26218)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 04:26:08.671933 tst ping.py:22: Test FAILED (6.6 sec) 04:26:08.700469 run osmo-hlr_10.42.42.2(pid=26215): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26215)] 04:26:08.749991 run osmo-hlr_10.42.42.2(pid=26215): stdout: | (launched: 2022-12-10_04:26:05.380709) 04:26:08.801577 run osmo-hlr_10.42.42.2(pid=26215): stderr: | 20221210042605578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042605578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042605578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042605578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042605579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042605579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042605591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042605599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042605599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042605599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:08.853606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26214): Terminating (SIGTERM) 04:26:08.895185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26217): Terminating (SIGTERM) 04:26:08.936799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26220): Terminating (SIGTERM) 04:26:08.979050 --- ParallelTerminationStrategy: PID 26214 died... 04:26:08.999170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26214): Terminated: ok {rc=0} 04:26:09.045482 --- ParallelTerminationStrategy: PID 26217 died... 04:26:09.065077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26217): Terminated: ok {rc=0} 04:26:09.110956 --- ParallelTerminationStrategy: PID 26220 died... 04:26:09.130744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26220): Terminated: ok {rc=0} 04:26:09.217428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:26:10.305279 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.317419 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:10.389874 tst ping_idle_ping.py: using LAC 25978 04:26:10.508686 tst ping_idle_ping.py: using RAC 223 04:26:10.625451 tst ping_idle_ping.py: using CellId 25978 04:26:10.748806 tst ping_idle_ping.py: using BVCI 25979 04:26:10.858126 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.869175 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.880070 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.891466 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.902733 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.914306 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.925851 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:10.937078 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:11.054778 tst ping_idle_ping.py:24: start network... 04:26:11.269889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:11.766359 run create_hlr_db(pid=26222): Launched 04:26:11.895951 bus /gobi_6: Setting Powered False 04:26:12.960213 run create_hlr_db(pid=26222): Terminated: ok {rc=0} 04:26:13.405660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Launched 04:26:13.724229 run osmo-hlr_10.42.42.2(pid=26225): Launched 04:26:13.845658 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:14.394820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26227): Launched 04:26:14.713132 run osmo-stp_10.42.42.5(pid=26228): Launched 04:26:14.834934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:15.386166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26230): Launched 04:26:15.507163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:15.776024 run patchelf(pid=26231): Launched 04:26:15.977140 run osmo-stp_10.42.42.5(pid=26228): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26228)] 04:26:16.114126 run osmo-stp_10.42.42.5(pid=26228): stdout: | (launched: 2022-12-10_04:26:14.654513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:16.246356 run osmo-stp_10.42.42.5(pid=26228): stderr: | 20221210042614844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042614844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042614844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042614844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042614847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042614847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042614847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:16.380714 run osmo-stp_10.42.42.5(pid=26228): stdout: | (launched: 2022-12-10_04:26:14.654513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:16.508576 run osmo-stp_10.42.42.5(pid=26228): stderr: | 20221210042614844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042614844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042614844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042614844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042614847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042614847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042614847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:16.662096 run patchelf(pid=26231): Terminating (SIGINT) 04:26:16.848295 run patchelf(pid=26231): Terminated: ok {rc=0} 04:26:17.001466 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26228): Process ended prematurely: osmo-stp_10.42.42.5(pid=26228) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26228)] [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:26:17.011793 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:26:17.042696 run osmo-hlr_10.42.42.2(pid=26225): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26225)] 04:26:17.093831 run osmo-hlr_10.42.42.2(pid=26225): stdout: | (launched: 2022-12-10_04:26:13.666004) 04:26:17.147368 run osmo-hlr_10.42.42.2(pid=26225): stderr: | 20221210042613863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042613863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042613863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042613863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042613864 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042613864 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042613876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042613884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042613884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042613884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:17.200510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Terminating (SIGTERM) 04:26:17.243770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26227): Terminating (SIGTERM) 04:26:17.289193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26230): Terminating (SIGTERM) 04:26:17.333194 --- ParallelTerminationStrategy: PID 26224 died... 04:26:17.352647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26224): Terminated: ok {rc=0} 04:26:17.398099 --- ParallelTerminationStrategy: PID 26227 died... 04:26:17.416840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26227): Terminated: ok {rc=0} 04:26:17.461786 --- ParallelTerminationStrategy: PID 26230 died... 04:26:17.480693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26230): Terminated: ok {rc=0} 04:26:17.567955 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:26:18.876850 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:26:18.884576 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:26:18.918820 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:26:18.954197 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:26:19.008902 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:26:19.043146 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:26:19.078385 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:26:19.642003 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:26:19.648177 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:19.660850 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:26:19.731012 tst switch_tch_pdch.py: using LAC 25979 04:26:19.855582 tst switch_tch_pdch.py: using RAC 224 04:26:19.977940 tst switch_tch_pdch.py: using CellId 25979 04:26:20.100554 tst switch_tch_pdch.py: using BVCI 25980 04:26:20.215938 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:20.227584 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:20.239065 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:20.250495 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:20.261905 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:20.273333 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:20.284833 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:26:20.296251 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:26:20.412105 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:26:20.537464 tst switch_tch_pdch.py:51: start network... 04:26:20.739094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:21.200720 run create_hlr_db(pid=26237): Launched 04:26:21.314015 bus /gobi_6: Setting Powered False 04:26:22.373665 run create_hlr_db(pid=26237): Terminated: ok {rc=0} 04:26:22.806862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26239): Launched 04:26:23.123842 run osmo-hlr_10.42.42.2(pid=26240): Launched 04:26:23.245294 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:23.791698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26242): Launched 04:26:24.109730 run osmo-stp_10.42.42.5(pid=26243): Launched 04:26:24.230988 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:24.779217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26245): Launched 04:26:24.900391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:25.168152 run patchelf(pid=26246): Launched 04:26:25.344383 run osmo-stp_10.42.42.5(pid=26243): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26243)] 04:26:25.478860 run osmo-stp_10.42.42.5(pid=26243): stdout: | (launched: 2022-12-10_04:26:24.051197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:25.614524 run osmo-stp_10.42.42.5(pid=26243): stderr: | 20221210042624242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042624242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042624243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042624243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042624245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042624246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042624246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:25.750506 run osmo-stp_10.42.42.5(pid=26243): stdout: | (launched: 2022-12-10_04:26:24.051197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:25.879890 run osmo-stp_10.42.42.5(pid=26243): stderr: | 20221210042624242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042624242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042624243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042624243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042624245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042624246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042624246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:26.033793 run patchelf(pid=26246): Terminating (SIGINT) 04:26:26.211127 run patchelf(pid=26246): Terminated: ok {rc=0} 04:26:26.339168 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26243): Process ended prematurely: osmo-stp_10.42.42.5(pid=26243) [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26243)] [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:26:26.348685 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:26:26.376738 run osmo-hlr_10.42.42.2(pid=26240): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26240)] 04:26:26.426009 run osmo-hlr_10.42.42.2(pid=26240): stdout: | (launched: 2022-12-10_04:26:23.066071) 04:26:26.476883 run osmo-hlr_10.42.42.2(pid=26240): stderr: | 20221210042623262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042623262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042623262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042623262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042623262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042623262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042623280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042623289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042623289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042623289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:26.528145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26239): Terminating (SIGTERM) 04:26:26.569269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26242): Terminating (SIGTERM) 04:26:26.610556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26245): Terminating (SIGTERM) 04:26:26.651884 --- ParallelTerminationStrategy: PID 26239 died... 04:26:26.671776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26239): Terminated: ok {rc=0} 04:26:26.717339 --- ParallelTerminationStrategy: PID 26242 died... 04:26:26.736426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26242): Terminated: ok {rc=0} 04:26:26.782169 --- ParallelTerminationStrategy: PID 26245 died... 04:26:26.801486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26245): Terminated: ok {rc=0} 04:26:26.888239 bus /gobi_0: Setting Powered False 04:26:27.984921 bus /gobi_0: Setting Powered False 04:26:29.099700 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:26:30.353939 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:26:30.359934 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:26:30.393631 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:26:30.428828 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:26:30.483051 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:26:30.516804 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:26:30.551938 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:26:31.119182 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:26:31.125484 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.137941 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:26:31.223390 tst switch_tch_pdch.py: using LAC 25980 04:26:31.384200 tst switch_tch_pdch.py: using RAC 225 04:26:31.534804 tst switch_tch_pdch.py: using CellId 25980 04:26:31.662270 tst switch_tch_pdch.py: using BVCI 25981 04:26:31.809152 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.821667 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.833934 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.846964 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.859487 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.871770 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.884615 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:26:31.897498 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:26:32.019332 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:26:32.142000 tst switch_tch_pdch.py:51: start network... 04:26:32.349211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:32.786530 run create_hlr_db(pid=26251): Launched 04:26:32.899486 bus /gobi_6: Setting Powered False 04:26:33.962056 run create_hlr_db(pid=26251): Terminated: ok {rc=0} 04:26:34.362668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26253): Launched 04:26:34.660522 run osmo-hlr_10.42.42.2(pid=26254): Launched 04:26:34.773707 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:35.270299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26256): Launched 04:26:35.566882 run osmo-stp_10.42.42.5(pid=26257): Launched 04:26:35.679677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:36.168064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26259): Launched 04:26:36.281777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:36.533478 run patchelf(pid=26260): Launched 04:26:36.698622 run osmo-stp_10.42.42.5(pid=26257): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26257)] 04:26:36.824241 run osmo-stp_10.42.42.5(pid=26257): stdout: | (launched: 2022-12-10_04:26:35.512095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:36.951795 run osmo-stp_10.42.42.5(pid=26257): stderr: | 20221210042635684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042635685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042635685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042635685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042635686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042635686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042635686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:37.079259 run osmo-stp_10.42.42.5(pid=26257): stdout: | (launched: 2022-12-10_04:26:35.512095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:37.201328 run osmo-stp_10.42.42.5(pid=26257): stderr: | 20221210042635684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042635685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042635685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042635685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042635686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042635686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042635686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:37.345445 run patchelf(pid=26260): Terminating (SIGINT) 04:26:37.512463 run patchelf(pid=26260): Terminated: ok {rc=0} 04:26:37.632940 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26257): Process ended prematurely: osmo-stp_10.42.42.5(pid=26257) [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26257)] [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:26:37.642002 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:26:37.668857 run osmo-hlr_10.42.42.2(pid=26254): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26254)] 04:26:37.716199 run osmo-hlr_10.42.42.2(pid=26254): stdout: | (launched: 2022-12-10_04:26:34.605727) 04:26:37.765583 run osmo-hlr_10.42.42.2(pid=26254): stderr: | 20221210042634784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042634784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042634784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042634784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042634785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042634785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042634797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042634805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042634805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042634806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:37.815177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26253): Terminating (SIGTERM) 04:26:37.854566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26256): Terminating (SIGTERM) 04:26:37.893886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26259): Terminating (SIGTERM) 04:26:37.933546 --- ParallelTerminationStrategy: PID 26253 died... 04:26:37.952229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26253): Terminated: ok {rc=0} 04:26:37.996053 --- ParallelTerminationStrategy: PID 26256 died... 04:26:38.014433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26256): Terminated: ok {rc=0} 04:26:38.058181 --- ParallelTerminationStrategy: PID 26259 died... 04:26:38.076659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26259): Terminated: ok {rc=0} 04:26:38.159923 bus /gobi_0: Setting Powered False 04:26:39.256353 bus /gobi_0: Setting Powered False 04:26:40.374962 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 04:26:41.624228 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:26:41.629506 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:26:41.659713 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 04:26:41.666753 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:26:41.719374 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:26:41.749054 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 04:26:41.755928 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:26:42.295344 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 04:26:42.300452 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 04:26:42.311832 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:26:42.356272 tst mo_mt_sms.py: using LAC 25981 04:26:42.481795 tst mo_mt_sms.py: using RAC 226 04:26:42.605069 tst mo_mt_sms.py: using CellId 25981 04:26:42.729201 tst mo_mt_sms.py: using BVCI 25982 04:26:42.844777 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:26:42.963432 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:26:43.077974 tst mo_mt_sms.py:9: start nitb and bts... 04:26:43.279797 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:26:43.888006 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26264): Launched 04:26:44.186279 run osmo-nitb_10.42.42.2(pid=26265): Launched 04:26:44.351944 run osmo-nitb_10.42.42.2(pid=26265): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26265)] 04:26:44.486087 run osmo-nitb_10.42.42.2(pid=26265): stdout: | (launched: 2022-12-10_04:26:44.130891) 04:26:44.621188 run osmo-nitb_10.42.42.2(pid=26265): stderr: | (launched: 2022-12-10_04:26:44.175127) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:26:44.757103 run osmo-nitb_10.42.42.2(pid=26265): stdout: | (launched: 2022-12-10_04:26:44.130891) 04:26:44.886276 run osmo-nitb_10.42.42.2(pid=26265): stderr: | (launched: 2022-12-10_04:26:44.175127) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26265): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26265) [trial-2369↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26265)] 04:26:45.298689 tst osmo-nitb_10.42.42.2(pid=26265): stdout: | (launched: 2022-12-10_04:26:44.130891) 04:26:45.419028 tst osmo-nitb_10.42.42.2(pid=26265): stderr: | (launched: 2022-12-10_04:26:44.175127) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:26:45.560663 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26265): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26265) [trial-2369↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26265)] [trial-2369↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 04:26:45.569210 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:26:45.575834 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26264): Terminating (SIGTERM) 04:26:45.785107 --- ParallelTerminationStrategy: PID 26264 died... 04:26:45.805657 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26264): Terminated: ok {rc=0} 04:26:45.892320 bus /sierra_3: Setting Powered False 04:26:46.992032 bus /sierra_3: Setting Powered False 04:26:48.113381 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 04:26:49.314299 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:26:49.318598 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:26:49.348674 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:26:49.376363 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:26:49.427411 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:26:49.457366 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:26:49.484777 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:26:50.035076 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 04:26:50.040162 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:26:50.051490 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:26:50.095626 tst mo_mt_sms.py: using LAC 25982 04:26:50.220866 tst mo_mt_sms.py: using RAC 227 04:26:50.345048 tst mo_mt_sms.py: using CellId 25982 04:26:50.468065 tst mo_mt_sms.py: using BVCI 25983 04:26:50.582936 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:26:50.594217 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:26:50.605449 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:26:50.616474 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:26:50.627587 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:26:50.638637 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:26:50.751663 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:26:50.867375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:51.330478 run create_hlr_db(pid=26269): Launched 04:26:51.444756 bus /sierra_2: Setting Powered False 04:26:52.504621 run create_hlr_db(pid=26269): Terminated: ok {rc=0} 04:26:52.921185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26271): Launched 04:26:53.219241 run osmo-hlr_10.42.42.2(pid=26272): Launched 04:26:53.332746 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:53.859207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26274): Launched 04:26:54.157589 run osmo-stp_10.42.42.5(pid=26275): Launched 04:26:54.271135 run osmo-msc_10.42.42.6: Starting osmo-msc 04:26:54.812392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26277): Launched 04:26:55.111073 run osmo-msc_10.42.42.6(pid=26278): Launched 04:26:55.278413 run osmo-stp_10.42.42.5(pid=26275): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26275)] 04:26:55.406626 run osmo-stp_10.42.42.5(pid=26275): stdout: | (launched: 2022-12-10_04:26:54.102623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:55.534641 run osmo-stp_10.42.42.5(pid=26275): stderr: | 20221210042654270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042654270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042654270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042654271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042654273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042654273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042654273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:55.659152 run osmo-stp_10.42.42.5(pid=26275): stdout: | (launched: 2022-12-10_04:26:54.102623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:55.778294 run osmo-stp_10.42.42.5(pid=26275): stderr: | 20221210042654270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042654270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042654270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042654271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042654273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042654273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042654273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:55.920913 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26275): Process ended prematurely: osmo-stp_10.42.42.5(pid=26275) [trial-2369↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26275)] [trial-2369↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 04:26:55.929598 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 04:26:55.956453 run osmo-hlr_10.42.42.2(pid=26272): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26272)] 04:26:56.003842 run osmo-hlr_10.42.42.2(pid=26272): stdout: | (launched: 2022-12-10_04:26:53.164271) 04:26:56.053307 run osmo-hlr_10.42.42.2(pid=26272): stderr: | 20221210042653341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042653341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042653341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042653341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042653341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042653341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042653352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042653361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042653361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042653361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:56.122055 run osmo-msc_10.42.42.6(pid=26278): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26278)] 04:26:56.169832 run osmo-msc_10.42.42.6(pid=26278): stdout: | (launched: 2022-12-10_04:26:55.055844) 04:26:56.219041 run osmo-msc_10.42.42.6(pid=26278): stderr: | 20221210042655328 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042655328 DLGLOBAL DEBUG validating counter group 0x7f3b6042ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042655328 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042655328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042655328 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042655328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042655330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042655331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042655331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042655331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:26:56.268866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26271): Terminating (SIGTERM) 04:26:56.308560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26274): Terminating (SIGTERM) 04:26:56.348476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26277): Terminating (SIGTERM) 04:26:56.388673 --- ParallelTerminationStrategy: PID 26271 died... 04:26:56.407738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26271): Terminated: ok {rc=0} 04:26:56.452186 --- ParallelTerminationStrategy: PID 26274 died... 04:26:56.470861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26274): Terminated: ok {rc=0} 04:26:56.515097 --- ParallelTerminationStrategy: PID 26277 died... 04:26:56.533862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26277): Terminated: ok {rc=0} 04:26:56.620277 bus /sierra_3: Setting Powered False 04:26:57.719684 bus /sierra_3: Setting Powered False 04:26:58.835034 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 04:27:00.063367 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:00.067535 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:27:00.098001 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 04:27:00.105223 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 04:27:00.142369 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:27:00.173279 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 04:27:00.180258 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 04:27:00.698884 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 04:27:00.704639 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 04:27:00.716327 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:27:00.761393 tst assert_extension.py: using LAC 25983 04:27:00.912099 tst assert_extension.py: using RAC 228 04:27:01.046808 tst assert_extension.py: using CellId 25983 04:27:01.165578 tst assert_extension.py: using BVCI 25984 04:27:01.319034 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 04:27:01.434409 tst assert_extension.py:10: start nitb and bts... 04:27:01.654825 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:27:02.354501 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26283): Launched 04:27:02.652915 run osmo-nitb_10.42.42.2(pid=26284): Launched 04:27:02.818885 run osmo-nitb_10.42.42.2(pid=26284): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26284)] 04:27:02.952739 run osmo-nitb_10.42.42.2(pid=26284): stdout: | (launched: 2022-12-10_04:27:02.598088) 04:27:03.088279 run osmo-nitb_10.42.42.2(pid=26284): stderr: | (launched: 2022-12-10_04:27:02.642306) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:27:03.223889 run osmo-nitb_10.42.42.2(pid=26284): stdout: | (launched: 2022-12-10_04:27:02.598088) 04:27:03.353610 run osmo-nitb_10.42.42.2(pid=26284): stderr: | (launched: 2022-12-10_04:27:02.642306) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26284): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26284) [trial-2369↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26284)] 04:27:03.765901 tst osmo-nitb_10.42.42.2(pid=26284): stdout: | (launched: 2022-12-10_04:27:02.598088) 04:27:03.886731 tst osmo-nitb_10.42.42.2(pid=26284): stderr: | (launched: 2022-12-10_04:27:02.642306) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:27:04.029370 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26284): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26284) [trial-2369↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26284)] [trial-2369↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 04:27:04.037830 tst assert_extension.py:12: Test FAILED (3.3 sec) 04:27:04.044464 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26283): Terminating (SIGTERM) 04:27:04.254946 --- ParallelTerminationStrategy: PID 26283 died... 04:27:04.275600 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26283): Terminated: ok {rc=0} 04:27:04.362036 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 04:27:05.537822 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:05.542238 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:27:05.572357 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:27:05.599963 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 04:27:05.635379 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:27:05.665866 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:27:05.693406 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 04:27:06.224724 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 04:27:06.230260 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:06.241700 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:27:06.287436 tst assert_extension.py: using LAC 25984 04:27:06.415112 tst assert_extension.py: using RAC 229 04:27:06.541751 tst assert_extension.py: using CellId 25984 04:27:06.665758 tst assert_extension.py: using BVCI 25985 04:27:06.774884 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:06.785904 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:06.796667 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:06.807751 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:06.818838 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:06.830009 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 04:27:06.945226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:07.437855 run create_hlr_db(pid=26289): Launched 04:27:07.566442 bus /sierra_2: Setting Powered False 04:27:08.629404 run create_hlr_db(pid=26289): Terminated: ok {rc=0} 04:27:09.054518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26291): Launched 04:27:09.352429 run osmo-hlr_10.42.42.2(pid=26292): Launched 04:27:09.466198 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:09.982591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26294): Launched 04:27:10.281428 run osmo-stp_10.42.42.5(pid=26295): Launched 04:27:10.395285 run osmo-msc_10.42.42.6: Starting osmo-msc 04:27:10.932896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26297): Launched 04:27:11.231579 run osmo-msc_10.42.42.6(pid=26298): Launched 04:27:11.398542 run osmo-stp_10.42.42.5(pid=26295): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26295)] 04:27:11.524879 run osmo-stp_10.42.42.5(pid=26295): stdout: | (launched: 2022-12-10_04:27:10.226291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:11.650790 run osmo-stp_10.42.42.5(pid=26295): stderr: | 20221210042710398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042710398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042710398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042710398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042710399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042710399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042710399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:11.774387 run osmo-stp_10.42.42.5(pid=26295): stdout: | (launched: 2022-12-10_04:27:10.226291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:11.892538 run osmo-stp_10.42.42.5(pid=26295): stderr: | 20221210042710398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042710398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042710398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042710398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042710399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042710399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042710399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:12.034764 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26295): Process ended prematurely: osmo-stp_10.42.42.5(pid=26295) [trial-2369↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26295)] [trial-2369↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 04:27:12.043028 tst assert_extension.py:17: Test FAILED (5.8 sec) 04:27:12.069771 run osmo-hlr_10.42.42.2(pid=26292): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26292)] 04:27:12.117370 run osmo-hlr_10.42.42.2(pid=26292): stdout: | (launched: 2022-12-10_04:27:09.297627) 04:27:12.166191 run osmo-hlr_10.42.42.2(pid=26292): stderr: | 20221210042709471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042709471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042709471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042709471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042709471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042709471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042709483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042709494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042709494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042709494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:12.234751 run osmo-msc_10.42.42.6(pid=26298): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26298)] 04:27:12.282116 run osmo-msc_10.42.42.6(pid=26298): stdout: | (launched: 2022-12-10_04:27:11.176568) 04:27:12.331350 run osmo-msc_10.42.42.6(pid=26298): stderr: | 20221210042711447 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042711447 DLGLOBAL DEBUG validating counter group 0x7f37674d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042711447 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042711447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042711447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042711447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042711449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042711450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042711450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042711450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:27:12.381344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26291): Terminating (SIGTERM) 04:27:12.420903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26294): Terminating (SIGTERM) 04:27:12.460559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26297): Terminating (SIGTERM) 04:27:12.500292 --- ParallelTerminationStrategy: PID 26291 died... 04:27:12.519244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26291): Terminated: ok {rc=0} 04:27:12.563193 --- ParallelTerminationStrategy: PID 26294 died... 04:27:12.581632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26294): Terminated: ok {rc=0} 04:27:12.625435 --- ParallelTerminationStrategy: PID 26297 died... 04:27:12.643967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26297): Terminated: ok {rc=0} 04:27:12.726641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:27:13.930279 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:13.936571 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:27:13.965869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:27:13.992888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:27:14.044163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:27:14.073321 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:27:14.099860 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:27:14.653667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:27:14.708573 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:14.721166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:27:14.789517 tst mo_mt_call.py: using LAC 25985 04:27:14.910662 tst mo_mt_call.py: using RAC 230 04:27:15.031577 tst mo_mt_call.py: using CellId 25985 04:27:15.160834 tst mo_mt_call.py: using BVCI 25986 04:27:15.273311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:15.284509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:15.295713 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:15.307077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:15.318700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:15.330094 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:27:15.447890 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:27:15.565134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:16.059005 run create_hlr_db(pid=26303): Launched 04:27:16.214763 bus /sierra_2: Setting Powered False 04:27:17.276454 run create_hlr_db(pid=26303): Terminated: ok {rc=0} 04:27:17.718768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26305): Launched 04:27:18.044134 run osmo-hlr_10.42.42.2(pid=26306): Launched 04:27:18.169085 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:18.724805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26308): Launched 04:27:19.048297 run osmo-stp_10.42.42.5(pid=26309): Launched 04:27:19.172408 run osmo-msc_10.42.42.6: Starting osmo-msc 04:27:19.757168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26311): Launched 04:27:20.080434 run osmo-msc_10.42.42.6(pid=26312): Launched 04:27:20.261429 run osmo-stp_10.42.42.5(pid=26309): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26309)] 04:27:20.397788 run osmo-stp_10.42.42.5(pid=26309): stdout: | (launched: 2022-12-10_04:27:18.989252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:20.534820 run osmo-stp_10.42.42.5(pid=26309): stderr: | 20221210042719183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042719183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042719183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042719184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042719184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042719184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042719184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:20.670148 run osmo-stp_10.42.42.5(pid=26309): stdout: | (launched: 2022-12-10_04:27:18.989252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:20.798980 run osmo-stp_10.42.42.5(pid=26309): stderr: | 20221210042719183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042719183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042719183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042719184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042719184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042719184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042719184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:20.952496 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26309): Process ended prematurely: osmo-stp_10.42.42.5(pid=26309) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26309)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:27:20.962415 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:27:20.990471 run osmo-hlr_10.42.42.2(pid=26306): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26306)] 04:27:21.042201 run osmo-hlr_10.42.42.2(pid=26306): stdout: | (launched: 2022-12-10_04:27:17.984940) 04:27:21.093856 run osmo-hlr_10.42.42.2(pid=26306): stderr: | 20221210042718185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042718185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042718185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042718186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042718186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042718186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042718201 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042718209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042718209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042718209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:21.166025 run osmo-msc_10.42.42.6(pid=26312): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26312)] 04:27:21.216091 run osmo-msc_10.42.42.6(pid=26312): stdout: | (launched: 2022-12-10_04:27:20.021005) 04:27:21.267388 run osmo-msc_10.42.42.6(pid=26312): stderr: | 20221210042720345 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042720345 DLGLOBAL DEBUG validating counter group 0x7fa78b9aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042720345 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042720345 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042720345 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042720345 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042720347 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042720347 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042720348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042720348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:27:21.319018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26305): Terminating (SIGTERM) 04:27:21.360350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26308): Terminating (SIGTERM) 04:27:21.401765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26311): Terminating (SIGTERM) 04:27:21.443585 --- ParallelTerminationStrategy: PID 26305 died... 04:27:21.463172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26305): Terminated: ok {rc=0} 04:27:21.508932 --- ParallelTerminationStrategy: PID 26308 died... 04:27:21.528652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26308): Terminated: ok {rc=0} 04:27:21.574441 --- ParallelTerminationStrategy: PID 26311 died... 04:27:21.593996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26311): Terminated: ok {rc=0} 04:27:21.680616 bus /sierra_3: Setting Powered False 04:27:22.778819 bus /sierra_3: Setting Powered False 04:27:23.895284 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:27:25.045282 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:25.057751 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:27:25.124524 tst mo_mt_call_osmux.py: using LAC 25986 04:27:25.251746 tst mo_mt_call_osmux.py: using RAC 231 04:27:25.378516 tst mo_mt_call_osmux.py: using CellId 25986 04:27:25.506322 tst mo_mt_call_osmux.py: using BVCI 25987 04:27:25.623231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:25.634983 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:25.646535 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:25.658122 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:25.670360 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:27:25.682144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:27:25.801422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:27:25.916857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:26.387293 run create_hlr_db(pid=26314): Launched 04:27:26.503116 bus /sierra_2: Setting Powered False 04:27:27.565133 run create_hlr_db(pid=26314): Terminated: ok {rc=0} 04:27:28.007654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26316): Launched 04:27:28.332936 run osmo-hlr_10.42.42.2(pid=26317): Launched 04:27:28.456802 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:29.013563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26319): Launched 04:27:29.336487 run osmo-stp_10.42.42.5(pid=26320): Launched 04:27:29.459714 run osmo-msc_10.42.42.6: Starting osmo-msc 04:27:30.048897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26322): Launched 04:27:30.355444 run osmo-msc_10.42.42.6(pid=26323): Launched 04:27:30.525147 run osmo-stp_10.42.42.5(pid=26320): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26320)] 04:27:30.654348 run osmo-stp_10.42.42.5(pid=26320): stdout: | (launched: 2022-12-10_04:27:29.277693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:30.784689 run osmo-stp_10.42.42.5(pid=26320): stderr: | 20221210042729469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042729469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042729470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042729470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042729471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042729471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042729471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:30.913691 run osmo-stp_10.42.42.5(pid=26320): stdout: | (launched: 2022-12-10_04:27:29.277693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:31.037431 run osmo-stp_10.42.42.5(pid=26320): stderr: | 20221210042729469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042729469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042729470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042729470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042729471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042729471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042729471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:31.196184 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26320): Process ended prematurely: osmo-stp_10.42.42.5(pid=26320) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26320)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:27:31.207166 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:27:31.237096 run osmo-hlr_10.42.42.2(pid=26317): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26317)] 04:27:31.291457 run osmo-hlr_10.42.42.2(pid=26317): stdout: | (launched: 2022-12-10_04:27:28.273794) 04:27:31.346509 run osmo-hlr_10.42.42.2(pid=26317): stderr: | 20221210042728473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042728473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042728473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042728473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042728473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042728473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042728485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042728494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042728494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042728494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:31.419969 run osmo-msc_10.42.42.6(pid=26323): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26323)] 04:27:31.470996 run osmo-msc_10.42.42.6(pid=26323): stdout: | (launched: 2022-12-10_04:27:30.299188) 04:27:31.525100 run osmo-msc_10.42.42.6(pid=26323): stderr: | 20221210042730571 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042730571 DLGLOBAL DEBUG validating counter group 0x7fbb2c1a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042730571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042730571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042730571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042730572 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042730573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042730574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042730574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042730574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:27:31.578566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26316): Terminating (SIGTERM) 04:27:31.621830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26319): Terminating (SIGTERM) 04:27:31.664453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26322): Terminating (SIGTERM) 04:27:31.707850 --- ParallelTerminationStrategy: PID 26316 died... 04:27:31.729625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26316): Terminated: ok {rc=0} 04:27:31.778857 --- ParallelTerminationStrategy: PID 26319 died... 04:27:31.799451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26319): Terminated: ok {rc=0} 04:27:31.848232 --- ParallelTerminationStrategy: PID 26322 died... 04:27:31.869257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26322): Terminated: ok {rc=0} 04:27:31.960832 bus /sierra_3: Setting Powered False 04:27:33.058912 bus /sierra_3: Setting Powered False 04:27:34.170505 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:27:35.418235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:35.425338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:27:35.455808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:27:35.483253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:27:35.536256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:27:35.566291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:27:35.594034 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:27:36.147359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:27:36.200272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:36.212216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:27:36.279516 tst mo_mt_call.py: using LAC 25987 04:27:36.405036 tst mo_mt_call.py: using RAC 232 04:27:36.531539 tst mo_mt_call.py: using CellId 25987 04:27:36.663326 tst mo_mt_call.py: using BVCI 25988 04:27:36.775448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:36.786926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:36.798260 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:36.809962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:36.821606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:36.833052 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:27:36.952136 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:27:37.068569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:37.540003 run create_hlr_db(pid=26328): Launched 04:27:37.657066 bus /sierra_2: Setting Powered False 04:27:38.718476 run create_hlr_db(pid=26328): Terminated: ok {rc=0} 04:27:39.161369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26330): Launched 04:27:39.485641 run osmo-hlr_10.42.42.2(pid=26331): Launched 04:27:39.609992 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:40.168527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26333): Launched 04:27:40.492884 run osmo-stp_10.42.42.5(pid=26334): Launched 04:27:40.617087 run osmo-msc_10.42.42.6: Starting osmo-msc 04:27:41.206271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26336): Launched 04:27:41.532247 run osmo-msc_10.42.42.6(pid=26337): Launched 04:27:41.713475 run osmo-stp_10.42.42.5(pid=26334): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26334)] 04:27:41.849451 run osmo-stp_10.42.42.5(pid=26334): stdout: | (launched: 2022-12-10_04:27:40.433745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:41.987589 run osmo-stp_10.42.42.5(pid=26334): stderr: | 20221210042740627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042740628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042740628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042740628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042740629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042740629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042740629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:42.123683 run osmo-stp_10.42.42.5(pid=26334): stdout: | (launched: 2022-12-10_04:27:40.433745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:42.252773 run osmo-stp_10.42.42.5(pid=26334): stderr: | 20221210042740627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042740628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042740628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042740628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042740629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042740629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042740629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:42.407674 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26334): Process ended prematurely: osmo-stp_10.42.42.5(pid=26334) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26334)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:27:42.417307 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:27:42.445166 run osmo-hlr_10.42.42.2(pid=26331): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26331)] 04:27:42.494769 run osmo-hlr_10.42.42.2(pid=26331): stdout: | (launched: 2022-12-10_04:27:39.426430) 04:27:42.546085 run osmo-hlr_10.42.42.2(pid=26331): stderr: | 20221210042739625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042739625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042739625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042739625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042739625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042739625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042739641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042739650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042739650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042739650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:42.618028 run osmo-msc_10.42.42.6(pid=26337): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26337)] 04:27:42.667577 run osmo-msc_10.42.42.6(pid=26337): stdout: | (launched: 2022-12-10_04:27:41.472494) 04:27:42.718663 run osmo-msc_10.42.42.6(pid=26337): stderr: | 20221210042741796 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042741797 DLGLOBAL DEBUG validating counter group 0x7f7282b18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042741797 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042741797 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042741797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042741797 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042741799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042741799 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042741799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042741799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:27:42.770426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26330): Terminating (SIGTERM) 04:27:42.812052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26333): Terminating (SIGTERM) 04:27:42.853726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26336): Terminating (SIGTERM) 04:27:42.895685 --- ParallelTerminationStrategy: PID 26330 died... 04:27:42.915579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26330): Terminated: ok {rc=0} 04:27:42.961538 --- ParallelTerminationStrategy: PID 26333 died... 04:27:42.980759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26333): Terminated: ok {rc=0} 04:27:43.026512 --- ParallelTerminationStrategy: PID 26336 died... 04:27:43.045869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26336): Terminated: ok {rc=0} 04:27:43.131860 bus /sierra_3: Setting Powered False 04:27:44.229017 bus /sierra_3: Setting Powered False 04:27:45.345313 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:27:46.489763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:46.502871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:27:46.575028 tst mo_mt_call_osmux.py: using LAC 25988 04:27:46.733846 tst mo_mt_call_osmux.py: using RAC 233 04:27:46.871957 tst mo_mt_call_osmux.py: using CellId 25988 04:27:47.047258 tst mo_mt_call_osmux.py: using BVCI 25989 04:27:47.190399 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:47.202777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:47.215038 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:47.227191 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:47.239266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:27:47.251291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:27:47.372550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:27:47.488481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:47.959141 run create_hlr_db(pid=26339): Launched 04:27:48.074742 bus /sierra_2: Setting Powered False 04:27:49.136232 run create_hlr_db(pid=26339): Terminated: ok {rc=0} 04:27:49.580508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26341): Launched 04:27:49.904063 run osmo-hlr_10.42.42.2(pid=26342): Launched 04:27:50.027644 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:50.586006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26344): Launched 04:27:50.909522 run osmo-stp_10.42.42.5(pid=26345): Launched 04:27:51.032937 run osmo-msc_10.42.42.6: Starting osmo-msc 04:27:51.619219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26347): Launched 04:27:51.948072 run osmo-msc_10.42.42.6(pid=26348): Launched 04:27:52.132167 run osmo-stp_10.42.42.5(pid=26345): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26345)] 04:27:52.273690 run osmo-stp_10.42.42.5(pid=26345): stdout: | (launched: 2022-12-10_04:27:50.850126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:52.411911 run osmo-stp_10.42.42.5(pid=26345): stderr: | 20221210042751042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042751042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042751042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042751043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042751045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042751045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042751045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:52.548236 run osmo-stp_10.42.42.5(pid=26345): stdout: | (launched: 2022-12-10_04:27:50.850126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:52.677360 run osmo-stp_10.42.42.5(pid=26345): stderr: | 20221210042751042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042751042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042751042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042751043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042751045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042751045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042751045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:52.831749 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26345): Process ended prematurely: osmo-stp_10.42.42.5(pid=26345) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26345)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:27:52.841494 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:27:52.869423 run osmo-hlr_10.42.42.2(pid=26342): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26342)] 04:27:52.919500 run osmo-hlr_10.42.42.2(pid=26342): stdout: | (launched: 2022-12-10_04:27:49.844802) 04:27:52.970995 run osmo-hlr_10.42.42.2(pid=26342): stderr: | 20221210042750042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042750043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042750043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042750043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042750043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042750043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042750060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042750069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042750069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042750069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:53.043096 run osmo-msc_10.42.42.6(pid=26348): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26348)] 04:27:53.092770 run osmo-msc_10.42.42.6(pid=26348): stdout: | (launched: 2022-12-10_04:27:51.885345) 04:27:53.144216 run osmo-msc_10.42.42.6(pid=26348): stderr: | 20221210042752214 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042752215 DLGLOBAL DEBUG validating counter group 0x7f4644522c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042752215 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042752215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042752215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042752215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042752217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042752217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042752217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042752218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:27:53.196527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26341): Terminating (SIGTERM) 04:27:53.238263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26344): Terminating (SIGTERM) 04:27:53.279988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26347): Terminating (SIGTERM) 04:27:53.322132 --- ParallelTerminationStrategy: PID 26341 died... 04:27:53.342077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26341): Terminated: ok {rc=0} 04:27:53.388076 --- ParallelTerminationStrategy: PID 26344 died... 04:27:53.407873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26344): Terminated: ok {rc=0} 04:27:53.453852 --- ParallelTerminationStrategy: PID 26347 died... 04:27:53.473526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26347): Terminated: ok {rc=0} 04:27:53.562098 bus /sierra_3: Setting Powered False 04:27:54.662033 bus /sierra_3: Setting Powered False 04:27:55.776145 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:27:57.024351 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:57.031534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:27:57.061216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:27:57.088260 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:27:57.142475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:27:57.172681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:27:57.200532 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:27:57.752252 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:27:57.804213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:27:57.816142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:27:57.882407 tst mo_mt_call.py: using LAC 25989 04:27:58.008260 tst mo_mt_call.py: using RAC 234 04:27:58.131613 tst mo_mt_call.py: using CellId 25989 04:27:58.251283 tst mo_mt_call.py: using BVCI 25990 04:27:58.361616 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:27:58.373058 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:27:58.384462 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:27:58.396013 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:27:58.407995 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:27:58.419640 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:27:58.534830 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:27:58.653062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:59.157645 run create_hlr_db(pid=26353): Launched 04:27:59.290830 bus /sierra_2: Setting Powered False 04:28:00.355428 run create_hlr_db(pid=26353): Terminated: ok {rc=0} 04:28:00.791160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Launched 04:28:01.147511 run osmo-hlr_10.42.42.2(pid=26356): Launched 04:28:01.307671 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:02.003873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Launched 04:28:02.331048 run osmo-stp_10.42.42.5(pid=26359): Launched 04:28:02.472429 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:03.041646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26361): Launched 04:28:03.347973 run osmo-msc_10.42.42.6(pid=26362): Launched 04:28:03.519016 run osmo-stp_10.42.42.5(pid=26359): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] 04:28:03.648237 run osmo-stp_10.42.42.5(pid=26359): stdout: | (launched: 2022-12-10_04:28:02.269231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:03.778525 run osmo-stp_10.42.42.5(pid=26359): stderr: | 20221210042802481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042802481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042802482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042802482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042802483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042802483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042802483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:03.906056 run osmo-stp_10.42.42.5(pid=26359): stdout: | (launched: 2022-12-10_04:28:02.269231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:04.027308 run osmo-stp_10.42.42.5(pid=26359): stderr: | 20221210042802481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042802481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042802482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042802482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042802483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042802483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042802483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:04.172571 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26359): Process ended prematurely: osmo-stp_10.42.42.5(pid=26359) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:28:04.181892 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:28:04.209326 run osmo-hlr_10.42.42.2(pid=26356): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26356)] 04:28:04.257236 run osmo-hlr_10.42.42.2(pid=26356): stdout: | (launched: 2022-12-10_04:28:01.081483) 04:28:04.306689 run osmo-hlr_10.42.42.2(pid=26356): stderr: | 20221210042801477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042801477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042801477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042801477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042801477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042801477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042801506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042801519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042801519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042801519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:04.376063 run osmo-msc_10.42.42.6(pid=26362): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26362)] 04:28:04.423570 run osmo-msc_10.42.42.6(pid=26362): stdout: | (launched: 2022-12-10_04:28:03.291448) 04:28:04.473247 run osmo-msc_10.42.42.6(pid=26362): stderr: | 20221210042803563 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042803563 DLGLOBAL DEBUG validating counter group 0x7f97047cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042803563 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042803563 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042803563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042803564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042803565 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042803566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042803566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042803566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:04.522913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Terminating (SIGTERM) 04:28:04.562748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Terminating (SIGTERM) 04:28:04.602749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26361): Terminating (SIGTERM) 04:28:04.643362 --- ParallelTerminationStrategy: PID 26355 died... 04:28:04.662451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Terminated: ok {rc=0} 04:28:04.707223 --- ParallelTerminationStrategy: PID 26358 died... 04:28:04.725992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Terminated: ok {rc=0} 04:28:04.770433 --- ParallelTerminationStrategy: PID 26361 died... 04:28:04.788901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26361): Terminated: ok {rc=0} 04:28:04.875201 bus /sierra_3: Setting Powered False 04:28:05.974576 bus /sierra_3: Setting Powered False 04:28:07.090034 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:28:08.235956 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:08.248015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:28:08.314375 tst mo_mt_call_osmux.py: using LAC 25990 04:28:08.439403 tst mo_mt_call_osmux.py: using RAC 235 04:28:08.558348 tst mo_mt_call_osmux.py: using CellId 25990 04:28:08.678766 tst mo_mt_call_osmux.py: using BVCI 25991 04:28:08.788252 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:08.799503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:08.810603 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:08.821822 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:08.833236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:08.844377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:28:08.960076 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:28:09.079192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:09.583592 run create_hlr_db(pid=26364): Launched 04:28:09.715302 bus /sierra_2: Setting Powered False 04:28:10.779306 run create_hlr_db(pid=26364): Terminated: ok {rc=0} 04:28:11.211682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26366): Launched 04:28:11.515971 run osmo-hlr_10.42.42.2(pid=26367): Launched 04:28:11.631657 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:12.167628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26369): Launched 04:28:12.473434 run osmo-stp_10.42.42.5(pid=26370): Launched 04:28:12.590348 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:13.139875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26372): Launched 04:28:13.444327 run osmo-msc_10.42.42.6(pid=26373): Launched 04:28:13.615782 run osmo-stp_10.42.42.5(pid=26370): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26370)] 04:28:13.744613 run osmo-stp_10.42.42.5(pid=26370): stdout: | (launched: 2022-12-10_04:28:12.416448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:13.873464 run osmo-stp_10.42.42.5(pid=26370): stderr: | 20221210042812589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042812590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042812590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042812590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042812591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042812591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042812591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:13.999822 run osmo-stp_10.42.42.5(pid=26370): stdout: | (launched: 2022-12-10_04:28:12.416448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:14.120413 run osmo-stp_10.42.42.5(pid=26370): stderr: | 20221210042812589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042812590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042812590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042812590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042812591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042812591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042812591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:14.265230 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26370): Process ended prematurely: osmo-stp_10.42.42.5(pid=26370) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26370)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:28:14.274340 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:28:14.301437 run osmo-hlr_10.42.42.2(pid=26367): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26367)] 04:28:14.349406 run osmo-hlr_10.42.42.2(pid=26367): stdout: | (launched: 2022-12-10_04:28:11.460179) 04:28:14.398960 run osmo-hlr_10.42.42.2(pid=26367): stderr: | 20221210042811637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042811637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042811637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042811637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042811638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042811638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042811651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042811660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042811660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042811660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:14.467845 run osmo-msc_10.42.42.6(pid=26373): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26373)] 04:28:14.515517 run osmo-msc_10.42.42.6(pid=26373): stdout: | (launched: 2022-12-10_04:28:13.387567) 04:28:14.564940 run osmo-msc_10.42.42.6(pid=26373): stderr: | 20221210042813658 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042813658 DLGLOBAL DEBUG validating counter group 0x7fed96865c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042813658 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042813659 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042813659 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042813659 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042813661 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042813661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042813661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042813661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:14.614648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26366): Terminating (SIGTERM) 04:28:14.654104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26369): Terminating (SIGTERM) 04:28:14.693607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26372): Terminating (SIGTERM) 04:28:14.733790 --- ParallelTerminationStrategy: PID 26366 died... 04:28:14.752605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26366): Terminated: ok {rc=0} 04:28:14.797144 --- ParallelTerminationStrategy: PID 26369 died... 04:28:14.815904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26369): Terminated: ok {rc=0} 04:28:14.859937 --- ParallelTerminationStrategy: PID 26372 died... 04:28:14.878618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26372): Terminated: ok {rc=0} 04:28:14.963958 bus /sierra_3: Setting Powered False 04:28:16.069742 bus /sierra_3: Setting Powered False 04:28:17.198070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:28:18.457505 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:18.464241 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:28:18.494493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:28:18.522696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:28:18.575835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:28:18.605792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:28:18.633306 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:28:19.188145 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:28:19.240148 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:19.251897 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:28:19.323557 tst mo_mt_call.py: using LAC 25991 04:28:19.449911 tst mo_mt_call.py: using RAC 236 04:28:19.574676 tst mo_mt_call.py: using CellId 25991 04:28:19.699004 tst mo_mt_call.py: using BVCI 25992 04:28:19.816073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:19.827857 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:19.839461 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:19.851059 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:19.862738 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:19.874327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:28:19.991459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:28:20.107062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:20.581469 run create_hlr_db(pid=26378): Launched 04:28:20.697850 bus /sierra_2: Setting Powered False 04:28:21.759079 run create_hlr_db(pid=26378): Terminated: ok {rc=0} 04:28:22.203417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26380): Launched 04:28:22.529466 run osmo-hlr_10.42.42.2(pid=26381): Launched 04:28:22.654180 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:23.214805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26383): Launched 04:28:23.538645 run osmo-stp_10.42.42.5(pid=26384): Launched 04:28:23.661399 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:24.246932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26386): Launched 04:28:24.571197 run osmo-msc_10.42.42.6(pid=26387): Launched 04:28:24.751499 run osmo-stp_10.42.42.5(pid=26384): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26384)] 04:28:24.887636 run osmo-stp_10.42.42.5(pid=26384): stdout: | (launched: 2022-12-10_04:28:23.479702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:25.023975 run osmo-stp_10.42.42.5(pid=26384): stderr: | 20221210042823673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042823673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042823673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042823674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042823674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042823674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042823674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:25.160110 run osmo-stp_10.42.42.5(pid=26384): stdout: | (launched: 2022-12-10_04:28:23.479702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:25.289944 run osmo-stp_10.42.42.5(pid=26384): stderr: | 20221210042823673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042823673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042823673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042823674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042823674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042823674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042823674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:25.444655 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26384): Process ended prematurely: osmo-stp_10.42.42.5(pid=26384) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26384)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:28:25.454672 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:28:25.482714 run osmo-hlr_10.42.42.2(pid=26381): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26381)] 04:28:25.532719 run osmo-hlr_10.42.42.2(pid=26381): stdout: | (launched: 2022-12-10_04:28:22.469830) 04:28:25.584171 run osmo-hlr_10.42.42.2(pid=26381): stderr: | 20221210042822667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042822668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042822668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042822668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042822668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042822668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042822680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042822688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042822689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042822689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:25.656315 run osmo-msc_10.42.42.6(pid=26387): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26387)] 04:28:25.705899 run osmo-msc_10.42.42.6(pid=26387): stdout: | (launched: 2022-12-10_04:28:24.512004) 04:28:25.757279 run osmo-msc_10.42.42.6(pid=26387): stderr: | 20221210042824834 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042824834 DLGLOBAL DEBUG validating counter group 0x7f42ed3dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042824835 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042824835 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042824835 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042824835 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042824837 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042824837 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042824837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042824837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:25.809083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26380): Terminating (SIGTERM) 04:28:25.850495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26383): Terminating (SIGTERM) 04:28:25.892116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26386): Terminating (SIGTERM) 04:28:25.933792 --- ParallelTerminationStrategy: PID 26380 died... 04:28:25.953417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26380): Terminated: ok {rc=0} 04:28:25.999447 --- ParallelTerminationStrategy: PID 26383 died... 04:28:26.019025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26383): Terminated: ok {rc=0} 04:28:26.064832 --- ParallelTerminationStrategy: PID 26386 died... 04:28:26.084345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26386): Terminated: ok {rc=0} 04:28:26.171021 bus /sierra_3: Setting Powered False 04:28:27.269735 bus /sierra_3: Setting Powered False 04:28:28.387584 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:28:29.533768 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:29.545652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:28:29.611216 tst mo_mt_call_osmux.py: using LAC 25992 04:28:29.732238 tst mo_mt_call_osmux.py: using RAC 237 04:28:29.852529 tst mo_mt_call_osmux.py: using CellId 25992 04:28:29.973634 tst mo_mt_call_osmux.py: using BVCI 25993 04:28:30.093089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:30.105016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:30.116650 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:30.128369 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:30.140334 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:28:30.152034 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:28:30.273888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:28:30.393773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:30.897948 run create_hlr_db(pid=26389): Launched 04:28:31.071795 bus /sierra_2: Setting Powered False 04:28:32.132094 run create_hlr_db(pid=26389): Terminated: ok {rc=0} 04:28:32.559839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26391): Launched 04:28:32.863888 run osmo-hlr_10.42.42.2(pid=26392): Launched 04:28:32.979173 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:33.517091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26394): Launched 04:28:33.821376 run osmo-stp_10.42.42.5(pid=26395): Launched 04:28:33.935866 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:34.482728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26397): Launched 04:28:34.787168 run osmo-msc_10.42.42.6(pid=26398): Launched 04:28:34.956799 run osmo-stp_10.42.42.5(pid=26395): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26395)] 04:28:35.085351 run osmo-stp_10.42.42.5(pid=26395): stdout: | (launched: 2022-12-10_04:28:33.765205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:35.213430 run osmo-stp_10.42.42.5(pid=26395): stderr: | 20221210042833935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042833936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042833936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042833936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042833939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042833939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042833939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:35.339497 run osmo-stp_10.42.42.5(pid=26395): stdout: | (launched: 2022-12-10_04:28:33.765205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:35.459585 run osmo-stp_10.42.42.5(pid=26395): stderr: | 20221210042833935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042833936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042833936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042833936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042833939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042833939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042833939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:35.604104 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26395): Process ended prematurely: osmo-stp_10.42.42.5(pid=26395) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26395)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:28:35.613102 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:28:35.640119 run osmo-hlr_10.42.42.2(pid=26392): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26392)] 04:28:35.687312 run osmo-hlr_10.42.42.2(pid=26392): stdout: | (launched: 2022-12-10_04:28:32.807778) 04:28:35.736335 run osmo-hlr_10.42.42.2(pid=26392): stderr: | 20221210042832984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042832984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042832984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042832984 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042832984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042832984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042832996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042833005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042833006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042833006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:35.804729 run osmo-msc_10.42.42.6(pid=26398): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26398)] 04:28:35.852066 run osmo-msc_10.42.42.6(pid=26398): stdout: | (launched: 2022-12-10_04:28:34.730573) 04:28:35.900807 run osmo-msc_10.42.42.6(pid=26398): stderr: | 20221210042835002 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042835002 DLGLOBAL DEBUG validating counter group 0x7f961c4f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042835002 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042835002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042835003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042835003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042835004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042835006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042835006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042835006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:35.950181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26391): Terminating (SIGTERM) 04:28:35.989338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26394): Terminating (SIGTERM) 04:28:36.028834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26397): Terminating (SIGTERM) 04:28:36.068699 --- ParallelTerminationStrategy: PID 26391 died... 04:28:36.087772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26391): Terminated: ok {rc=0} 04:28:36.131851 --- ParallelTerminationStrategy: PID 26394 died... 04:28:36.150394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26394): Terminated: ok {rc=0} 04:28:36.194269 --- ParallelTerminationStrategy: PID 26397 died... 04:28:36.212623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26397): Terminated: ok {rc=0} 04:28:36.296000 bus /sierra_3: Setting Powered False 04:28:37.390456 bus /sierra_3: Setting Powered False 04:28:38.503581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:28:39.747704 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:39.754435 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:28:39.783679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:28:39.810332 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:28:39.862063 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:28:39.890860 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:28:39.917400 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:28:40.473528 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:28:40.522737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:40.534049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:28:40.598535 tst mo_mt_call.py: using LAC 25993 04:28:40.716837 tst mo_mt_call.py: using RAC 238 04:28:40.839404 tst mo_mt_call.py: using CellId 25993 04:28:40.956796 tst mo_mt_call.py: using BVCI 25994 04:28:41.066180 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:41.077634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:41.088594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:41.100014 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:41.111321 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:41.122641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:28:41.238978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:28:41.356648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:41.860177 run create_hlr_db(pid=26403): Launched 04:28:41.991326 bus /sierra_2: Setting Powered False 04:28:43.055365 run create_hlr_db(pid=26403): Terminated: ok {rc=0} 04:28:43.505103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26405): Launched 04:28:43.828588 run osmo-hlr_10.42.42.2(pid=26406): Launched 04:28:43.951710 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:44.509109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26408): Launched 04:28:44.832081 run osmo-stp_10.42.42.5(pid=26409): Launched 04:28:44.955048 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:45.540838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26411): Launched 04:28:45.873734 run osmo-msc_10.42.42.6(pid=26412): Launched 04:28:46.195405 run osmo-stp_10.42.42.5(pid=26409): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26409)] 04:28:46.345959 run osmo-stp_10.42.42.5(pid=26409): stdout: | (launched: 2022-12-10_04:28:44.773279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:46.507920 run osmo-stp_10.42.42.5(pid=26409): stderr: | 20221210042844964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042844964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042844965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042844965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042844967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042844967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042844967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:46.707654 run osmo-stp_10.42.42.5(pid=26409): stdout: | (launched: 2022-12-10_04:28:44.773279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:46.834846 run osmo-stp_10.42.42.5(pid=26409): stderr: | 20221210042844964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042844964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042844965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042844965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042844967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042844967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042844967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:46.986480 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26409): Process ended prematurely: osmo-stp_10.42.42.5(pid=26409) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26409)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:28:46.996634 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:28:47.027020 run osmo-hlr_10.42.42.2(pid=26406): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26406)] 04:28:47.077301 run osmo-hlr_10.42.42.2(pid=26406): stdout: | (launched: 2022-12-10_04:28:43.769458) 04:28:47.130186 run osmo-hlr_10.42.42.2(pid=26406): stderr: | 20221210042843968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042843968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042843968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042843969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042843969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042843969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042843979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042843988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042843988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042843988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:47.203161 run osmo-msc_10.42.42.6(pid=26412): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26412)] 04:28:47.253260 run osmo-msc_10.42.42.6(pid=26412): stdout: | (launched: 2022-12-10_04:28:45.805593) 04:28:47.305097 run osmo-msc_10.42.42.6(pid=26412): stderr: | 20221210042846320 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042846320 DLGLOBAL DEBUG validating counter group 0x7f640973dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042846320 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042846320 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042846321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042846321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042846332 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042846332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042846332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042846332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:47.358625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26405): Terminating (SIGTERM) 04:28:47.401384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26408): Terminating (SIGTERM) 04:28:47.445848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26411): Terminating (SIGTERM) 04:28:47.486079 --- ParallelTerminationStrategy: PID 26405 died... 04:28:47.504790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26405): Terminated: ok {rc=0} 04:28:47.549087 --- ParallelTerminationStrategy: PID 26408 died... 04:28:47.567622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26408): Terminated: ok {rc=0} 04:28:47.611647 --- ParallelTerminationStrategy: PID 26411 died... 04:28:47.630073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26411): Terminated: ok {rc=0} 04:28:47.715897 bus /sierra_3: Setting Powered False 04:28:48.814680 bus /sierra_3: Setting Powered False 04:28:49.927470 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:28:51.072434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:51.084542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:28:51.150583 tst mo_mt_call_osmux.py: using LAC 25994 04:28:51.270977 tst mo_mt_call_osmux.py: using RAC 239 04:28:51.398040 tst mo_mt_call_osmux.py: using CellId 25994 04:28:51.524571 tst mo_mt_call_osmux.py: using BVCI 25995 04:28:51.642166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:51.654116 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:51.665786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:51.677367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:51.689030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:28:51.700561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:28:51.820526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:28:51.937561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:52.409381 run create_hlr_db(pid=26415): Launched 04:28:52.525799 bus /sierra_2: Setting Powered False 04:28:53.587020 run create_hlr_db(pid=26415): Terminated: ok {rc=0} 04:28:54.011089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26417): Launched 04:28:54.315168 run osmo-hlr_10.42.42.2(pid=26418): Launched 04:28:54.431852 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:54.953148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26420): Launched 04:28:55.257499 run osmo-stp_10.42.42.5(pid=26421): Launched 04:28:55.373452 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:55.922191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26423): Launched 04:28:56.226329 run osmo-msc_10.42.42.6(pid=26424): Launched 04:28:56.396061 run osmo-stp_10.42.42.5(pid=26421): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26421)] 04:28:56.524701 run osmo-stp_10.42.42.5(pid=26421): stdout: | (launched: 2022-12-10_04:28:55.201127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:56.653773 run osmo-stp_10.42.42.5(pid=26421): stderr: | 20221210042855374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042855374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042855375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042855375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042855375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042855375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042855376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:56.780297 run osmo-stp_10.42.42.5(pid=26421): stdout: | (launched: 2022-12-10_04:28:55.201127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:56.901737 run osmo-stp_10.42.42.5(pid=26421): stderr: | 20221210042855374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042855374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042855375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042855375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042855375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042855375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042855376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:57.047051 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26421): Process ended prematurely: osmo-stp_10.42.42.5(pid=26421) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26421)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:28:57.056199 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:28:57.083580 run osmo-hlr_10.42.42.2(pid=26418): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26418)] 04:28:57.131467 run osmo-hlr_10.42.42.2(pid=26418): stdout: | (launched: 2022-12-10_04:28:54.259321) 04:28:57.180873 run osmo-hlr_10.42.42.2(pid=26418): stderr: | 20221210042854436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042854436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042854436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042854436 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042854436 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042854436 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042854460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042854470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042854470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042854470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:57.250006 run osmo-msc_10.42.42.6(pid=26424): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26424)] 04:28:57.297472 run osmo-msc_10.42.42.6(pid=26424): stdout: | (launched: 2022-12-10_04:28:56.170185) 04:28:57.346541 run osmo-msc_10.42.42.6(pid=26424): stderr: | 20221210042856440 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042856441 DLGLOBAL DEBUG validating counter group 0x7fa67ff70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042856441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042856441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042856441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042856441 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042856443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042856443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042856443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042856443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:57.396302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26417): Terminating (SIGTERM) 04:28:57.436145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26420): Terminating (SIGTERM) 04:28:57.475889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26423): Terminating (SIGTERM) 04:28:57.516004 --- ParallelTerminationStrategy: PID 26417 died... 04:28:57.535096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26417): Terminated: ok {rc=0} 04:28:57.579336 --- ParallelTerminationStrategy: PID 26420 died... 04:28:57.598014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26420): Terminated: ok {rc=0} 04:28:57.641984 --- ParallelTerminationStrategy: PID 26423 died... 04:28:57.660696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26423): Terminated: ok {rc=0} 04:28:57.744137 bus /sierra_3: Setting Powered False 04:28:58.838237 bus /sierra_3: Setting Powered False 04:28:59.954334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:29:01.203158 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:01.211281 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:29:01.249836 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:29:01.284587 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:29:01.349257 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:29:01.385866 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:29:01.414886 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:29:01.955215 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:29:02.022393 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:02.038381 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:29:02.119940 tst mo_mt_call.py: using LAC 25995 04:29:02.247552 tst mo_mt_call.py: using RAC 240 04:29:02.377339 tst mo_mt_call.py: using CellId 25995 04:29:02.503858 tst mo_mt_call.py: using BVCI 25996 04:29:02.620589 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:02.632717 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:02.644321 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:02.656036 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:02.667789 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:02.679426 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:29:02.794987 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:29:02.915182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:03.418820 run create_hlr_db(pid=26429): Launched 04:29:03.549433 bus /sierra_2: Setting Powered False 04:29:04.614277 run create_hlr_db(pid=26429): Terminated: ok {rc=0} 04:29:05.047724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26431): Launched 04:29:05.351992 run osmo-hlr_10.42.42.2(pid=26432): Launched 04:29:05.467231 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:06.003265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26434): Launched 04:29:06.307061 run osmo-stp_10.42.42.5(pid=26435): Launched 04:29:06.422375 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:06.973636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26437): Launched 04:29:07.277715 run osmo-msc_10.42.42.6(pid=26438): Launched 04:29:07.448186 run osmo-stp_10.42.42.5(pid=26435): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26435)] 04:29:07.578358 run osmo-stp_10.42.42.5(pid=26435): stdout: | (launched: 2022-12-10_04:29:06.250924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:07.707225 run osmo-stp_10.42.42.5(pid=26435): stderr: | 20221210042906423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042906423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042906423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042906424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042906424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042906424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042906425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:07.833862 run osmo-stp_10.42.42.5(pid=26435): stdout: | (launched: 2022-12-10_04:29:06.250924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:07.954992 run osmo-stp_10.42.42.5(pid=26435): stderr: | 20221210042906423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042906423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042906423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042906424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042906424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042906424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042906425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:08.099754 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26435): Process ended prematurely: osmo-stp_10.42.42.5(pid=26435) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26435)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:29:08.108862 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:29:08.136411 run osmo-hlr_10.42.42.2(pid=26432): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26432)] 04:29:08.183845 run osmo-hlr_10.42.42.2(pid=26432): stdout: | (launched: 2022-12-10_04:29:05.296089) 04:29:08.232797 run osmo-hlr_10.42.42.2(pid=26432): stderr: | 20221210042905474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042905474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042905474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042905474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042905474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042905475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042905487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042905497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042905498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042905498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:08.301912 run osmo-msc_10.42.42.6(pid=26438): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26438)] 04:29:08.349351 run osmo-msc_10.42.42.6(pid=26438): stdout: | (launched: 2022-12-10_04:29:07.221421) 04:29:08.398565 run osmo-msc_10.42.42.6(pid=26438): stderr: | 20221210042907494 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042907494 DLGLOBAL DEBUG validating counter group 0x7f38ea80fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042907494 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042907494 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042907494 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042907494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042907496 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042907497 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042907497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042907497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:08.448078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26431): Terminating (SIGTERM) 04:29:08.487526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26434): Terminating (SIGTERM) 04:29:08.527006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26437): Terminating (SIGTERM) 04:29:08.566802 --- ParallelTerminationStrategy: PID 26431 died... 04:29:08.585772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26431): Terminated: ok {rc=0} 04:29:08.629920 --- ParallelTerminationStrategy: PID 26434 died... 04:29:08.648468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26434): Terminated: ok {rc=0} 04:29:08.692585 --- ParallelTerminationStrategy: PID 26437 died... 04:29:08.711245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26437): Terminated: ok {rc=0} 04:29:08.796289 bus /sierra_3: Setting Powered False 04:29:09.895209 bus /sierra_3: Setting Powered False 04:29:11.011384 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:29:12.157469 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:12.169507 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:29:12.235025 tst mo_mt_call_osmux.py: using LAC 25996 04:29:12.354168 tst mo_mt_call_osmux.py: using RAC 241 04:29:12.483712 tst mo_mt_call_osmux.py: using CellId 25996 04:29:12.611249 tst mo_mt_call_osmux.py: using BVCI 25997 04:29:12.729322 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:12.741114 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:12.752781 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:12.764483 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:12.776872 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:12.788472 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:29:12.904576 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:29:13.025267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:13.530246 run create_hlr_db(pid=26440): Launched 04:29:13.661772 bus /sierra_2: Setting Powered False 04:29:14.726154 run create_hlr_db(pid=26440): Terminated: ok {rc=0} 04:29:15.177843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26442): Launched 04:29:15.502247 run osmo-hlr_10.42.42.2(pid=26443): Launched 04:29:15.625363 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:16.241800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26445): Launched 04:29:16.574073 run osmo-stp_10.42.42.5(pid=26446): Launched 04:29:16.815526 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:17.508143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26448): Launched 04:29:17.812579 run osmo-msc_10.42.42.6(pid=26449): Launched 04:29:17.982172 run osmo-stp_10.42.42.5(pid=26446): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26446)] 04:29:18.111257 run osmo-stp_10.42.42.5(pid=26446): stdout: | (launched: 2022-12-10_04:29:16.507834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:18.239578 run osmo-stp_10.42.42.5(pid=26446): stderr: | 20221210042916759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042916759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042916760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042916760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042916761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042916761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042916761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:18.365822 run osmo-stp_10.42.42.5(pid=26446): stdout: | (launched: 2022-12-10_04:29:16.507834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:18.486361 run osmo-stp_10.42.42.5(pid=26446): stderr: | 20221210042916759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042916759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042916760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042916760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042916761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042916761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042916761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:18.630813 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26446): Process ended prematurely: osmo-stp_10.42.42.5(pid=26446) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26446)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:29:18.639799 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:29:18.667087 run osmo-hlr_10.42.42.2(pid=26443): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26443)] 04:29:18.714414 run osmo-hlr_10.42.42.2(pid=26443): stdout: | (launched: 2022-12-10_04:29:15.442907) 04:29:18.763605 run osmo-hlr_10.42.42.2(pid=26443): stderr: | 20221210042915643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042915643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042915643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042915643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042915644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042915644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042915657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042915666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042915666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042915666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:18.832542 run osmo-msc_10.42.42.6(pid=26449): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26449)] 04:29:18.879879 run osmo-msc_10.42.42.6(pid=26449): stdout: | (launched: 2022-12-10_04:29:17.756366) 04:29:18.928899 run osmo-msc_10.42.42.6(pid=26449): stderr: | 20221210042918027 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042918027 DLGLOBAL DEBUG validating counter group 0x7fd1c6a03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042918027 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042918027 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042918028 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042918028 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042918030 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042918030 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042918030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042918030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:18.978335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26442): Terminating (SIGTERM) 04:29:19.017996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26445): Terminating (SIGTERM) 04:29:19.057689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26448): Terminating (SIGTERM) 04:29:19.097762 --- ParallelTerminationStrategy: PID 26442 died... 04:29:19.116691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26442): Terminated: ok {rc=0} 04:29:19.161231 --- ParallelTerminationStrategy: PID 26445 died... 04:29:19.179952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26445): Terminated: ok {rc=0} 04:29:19.224152 --- ParallelTerminationStrategy: PID 26448 died... 04:29:19.242856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26448): Terminated: ok {rc=0} 04:29:19.328554 bus /sierra_3: Setting Powered False 04:29:20.426778 bus /sierra_3: Setting Powered False 04:29:21.539688 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:29:22.793772 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:22.800524 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:29:22.830205 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:29:22.859238 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:29:22.911753 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:29:22.941431 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:29:22.968498 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:29:23.521851 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:29:23.573793 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:23.584862 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:29:23.651233 tst mo_mt_call.py: using LAC 25997 04:29:23.770077 tst mo_mt_call.py: using RAC 242 04:29:23.891337 tst mo_mt_call.py: using CellId 25997 04:29:24.010247 tst mo_mt_call.py: using BVCI 25998 04:29:24.121868 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:24.133023 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:24.143934 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:24.154982 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:24.166214 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:24.177329 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:29:24.290316 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:29:24.408861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:24.911700 run create_hlr_db(pid=26454): Launched 04:29:25.043590 bus /sierra_2: Setting Powered False 04:29:26.108702 run create_hlr_db(pid=26454): Terminated: ok {rc=0} 04:29:26.560100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26456): Launched 04:29:26.884085 run osmo-hlr_10.42.42.2(pid=26457): Launched 04:29:27.006875 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:27.565647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26459): Launched 04:29:27.889454 run osmo-stp_10.42.42.5(pid=26460): Launched 04:29:28.012110 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:28.603674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26462): Launched 04:29:28.928702 run osmo-msc_10.42.42.6(pid=26463): Launched 04:29:29.111923 run osmo-stp_10.42.42.5(pid=26460): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26460)] 04:29:29.250028 run osmo-stp_10.42.42.5(pid=26460): stdout: | (launched: 2022-12-10_04:29:27.830285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:29.387773 run osmo-stp_10.42.42.5(pid=26460): stderr: | 20221210042928024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042928024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042928024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042928025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042928025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042928025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042928025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:29.523780 run osmo-stp_10.42.42.5(pid=26460): stdout: | (launched: 2022-12-10_04:29:27.830285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:29.652880 run osmo-stp_10.42.42.5(pid=26460): stderr: | 20221210042928024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042928024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042928024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042928025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042928025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042928025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042928025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:29.807362 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26460): Process ended prematurely: osmo-stp_10.42.42.5(pid=26460) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26460)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:29:29.816910 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:29:29.845222 run osmo-hlr_10.42.42.2(pid=26457): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26457)] 04:29:29.895051 run osmo-hlr_10.42.42.2(pid=26457): stdout: | (launched: 2022-12-10_04:29:26.824872) 04:29:29.946586 run osmo-hlr_10.42.42.2(pid=26457): stderr: | 20221210042927027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042927027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042927027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042927027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042927027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042927027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042927040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042927048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042927048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042927048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:30.018626 run osmo-msc_10.42.42.6(pid=26463): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26463)] 04:29:30.068799 run osmo-msc_10.42.42.6(pid=26463): stdout: | (launched: 2022-12-10_04:29:28.869269) 04:29:30.120370 run osmo-msc_10.42.42.6(pid=26463): stderr: | 20221210042929192 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042929192 DLGLOBAL DEBUG validating counter group 0x7fe777f4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042929192 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042929192 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042929192 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042929193 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042929194 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042929195 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042929195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042929195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:30.172367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26456): Terminating (SIGTERM) 04:29:30.214263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26459): Terminating (SIGTERM) 04:29:30.256345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26462): Terminating (SIGTERM) 04:29:30.298590 --- ParallelTerminationStrategy: PID 26456 died... 04:29:30.318725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26456): Terminated: ok {rc=0} 04:29:30.365047 --- ParallelTerminationStrategy: PID 26459 died... 04:29:30.384729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26459): Terminated: ok {rc=0} 04:29:30.430901 --- ParallelTerminationStrategy: PID 26462 died... 04:29:30.450605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26462): Terminated: ok {rc=0} 04:29:30.538685 bus /sierra_3: Setting Powered False 04:29:31.633569 bus /sierra_3: Setting Powered False 04:29:32.748425 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:29:33.897622 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:33.909881 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:29:33.978215 tst mo_mt_call_osmux.py: using LAC 25998 04:29:34.106627 tst mo_mt_call_osmux.py: using RAC 243 04:29:34.236877 tst mo_mt_call_osmux.py: using CellId 25998 04:29:34.363956 tst mo_mt_call_osmux.py: using BVCI 25999 04:29:34.481573 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:34.493329 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:34.504636 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:34.516064 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:34.527573 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:29:34.538957 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:29:34.657377 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:29:34.773260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:35.245547 run create_hlr_db(pid=26465): Launched 04:29:35.362635 bus /sierra_2: Setting Powered False 04:29:36.423287 run create_hlr_db(pid=26465): Terminated: ok {rc=0} 04:29:36.847943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26467): Launched 04:29:37.153210 run osmo-hlr_10.42.42.2(pid=26468): Launched 04:29:37.270321 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:37.793006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26470): Launched 04:29:38.097709 run osmo-stp_10.42.42.5(pid=26471): Launched 04:29:38.213956 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:38.761724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26473): Launched 04:29:39.066587 run osmo-msc_10.42.42.6(pid=26474): Launched 04:29:39.237385 run osmo-stp_10.42.42.5(pid=26471): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26471)] 04:29:39.368640 run osmo-stp_10.42.42.5(pid=26471): stdout: | (launched: 2022-12-10_04:29:38.041438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:39.497478 run osmo-stp_10.42.42.5(pid=26471): stderr: | 20221210042938213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042938213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042938214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042938214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042938214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042938214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042938215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:39.623969 run osmo-stp_10.42.42.5(pid=26471): stdout: | (launched: 2022-12-10_04:29:38.041438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:39.744620 run osmo-stp_10.42.42.5(pid=26471): stderr: | 20221210042938213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042938213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042938214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042938214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042938214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042938214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042938215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:39.889455 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26471): Process ended prematurely: osmo-stp_10.42.42.5(pid=26471) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26471)] [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:29:39.898524 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:29:39.925228 run osmo-hlr_10.42.42.2(pid=26468): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26468)] 04:29:39.973715 run osmo-hlr_10.42.42.2(pid=26468): stdout: | (launched: 2022-12-10_04:29:37.096543) 04:29:40.022912 run osmo-hlr_10.42.42.2(pid=26468): stderr: | 20221210042937275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042937275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042937275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042937275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042937275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042937275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042937290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042937300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042937300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042937300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:40.091711 run osmo-msc_10.42.42.6(pid=26474): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26474)] 04:29:40.139236 run osmo-msc_10.42.42.6(pid=26474): stdout: | (launched: 2022-12-10_04:29:39.010152) 04:29:40.188364 run osmo-msc_10.42.42.6(pid=26474): stderr: | 20221210042939283 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042939283 DLGLOBAL DEBUG validating counter group 0x7f97df239c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042939283 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042939283 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042939284 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042939284 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042939286 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042939286 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042939286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042939286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:40.237933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26467): Terminating (SIGTERM) 04:29:40.277254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26470): Terminating (SIGTERM) 04:29:40.316604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26473): Terminating (SIGTERM) 04:29:40.356528 --- ParallelTerminationStrategy: PID 26467 died... 04:29:40.375572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26467): Terminated: ok {rc=0} 04:29:40.419715 --- ParallelTerminationStrategy: PID 26470 died... 04:29:40.438489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26470): Terminated: ok {rc=0} 04:29:40.482674 --- ParallelTerminationStrategy: PID 26473 died... 04:29:40.501254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26473): Terminated: ok {rc=0} 04:29:40.586858 bus /sierra_3: Setting Powered False 04:29:41.684456 bus /sierra_3: Setting Powered False 04:29:42.799178 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 04:29:44.044927 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:44.049670 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:29:44.079722 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:29:44.107083 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 04:29:44.193335 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:29:44.222922 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:29:44.250543 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 04:29:44.837392 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 04:29:44.842538 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:44.853935 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:29:44.899588 tst emergency_mo_mt_call.py: using LAC 25999 04:29:45.023857 tst emergency_mo_mt_call.py: using RAC 244 04:29:45.147471 tst emergency_mo_mt_call.py: using CellId 25999 04:29:45.270425 tst emergency_mo_mt_call.py: using BVCI 26000 04:29:45.379855 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:45.390989 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:45.401905 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:45.412801 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:45.423653 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:45.434696 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:29:45.552475 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:29:45.666474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:46.156018 run create_hlr_db(pid=26479): Launched 04:29:46.303913 bus /sierra_2: Setting Powered False 04:29:47.364478 run create_hlr_db(pid=26479): Terminated: ok {rc=0} 04:29:47.784542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Launched 04:29:48.083762 run osmo-hlr_10.42.42.2(pid=26482): Launched 04:29:48.197694 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:48.722510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Launched 04:29:49.020547 run osmo-stp_10.42.42.5(pid=26485): Launched 04:29:49.144846 tst emergency_mo_mt_call.py: using MSISDN 7549 04:29:49.313260 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:49.852176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26487): Launched 04:29:50.151042 run osmo-msc_10.42.42.6(pid=26488): Launched 04:29:50.317978 run osmo-stp_10.42.42.5(pid=26485): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] 04:29:50.443965 run osmo-stp_10.42.42.5(pid=26485): stdout: | (launched: 2022-12-10_04:29:48.965201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:50.570413 run osmo-stp_10.42.42.5(pid=26485): stderr: | 20221210042949136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042949136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042949136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042949137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042949138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042949138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042949138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:50.695249 run osmo-stp_10.42.42.5(pid=26485): stdout: | (launched: 2022-12-10_04:29:48.965201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:50.814750 run osmo-stp_10.42.42.5(pid=26485): stderr: | 20221210042949136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042949136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042949136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042949137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042949138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042949138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042949138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:50.957194 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26485): Process ended prematurely: osmo-stp_10.42.42.5(pid=26485) [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 04:29:50.965473 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 04:29:50.992190 run osmo-hlr_10.42.42.2(pid=26482): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26482)] 04:29:51.039563 run osmo-hlr_10.42.42.2(pid=26482): stdout: | (launched: 2022-12-10_04:29:48.028375) 04:29:51.088793 run osmo-hlr_10.42.42.2(pid=26482): stderr: | 20221210042948206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042948206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042948206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042948206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042948206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042948206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042948218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042948227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042948227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042948227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:51.157301 run osmo-msc_10.42.42.6(pid=26488): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26488)] 04:29:51.204728 run osmo-msc_10.42.42.6(pid=26488): stdout: | (launched: 2022-12-10_04:29:50.095799) 04:29:51.253824 run osmo-msc_10.42.42.6(pid=26488): stderr: | 20221210042950371 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210042950371 DLGLOBAL DEBUG validating counter group 0x7ff0768abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210042950371 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210042950371 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210042950371 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210042950371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210042950373 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210042950374 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210042950374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210042950374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:51.303942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Terminating (SIGTERM) 04:29:51.343494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Terminating (SIGTERM) 04:29:51.383041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26487): Terminating (SIGTERM) 04:29:51.422954 --- ParallelTerminationStrategy: PID 26481 died... 04:29:51.441907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Terminated: ok {rc=0} 04:29:51.486024 --- ParallelTerminationStrategy: PID 26484 died... 04:29:51.504585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Terminated: ok {rc=0} 04:29:51.548912 --- ParallelTerminationStrategy: PID 26487 died... 04:29:51.567634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26487): Terminated: ok {rc=0} 04:29:51.652536 bus /sierra_3: Setting Powered False 04:29:52.750560 bus /sierra_3: Setting Powered False 04:29:53.866862 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 04:29:54.949432 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:54.960895 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:29:55.008472 tst emergency_preemptive_call.py: using LAC 26000 04:29:55.127106 tst emergency_preemptive_call.py: using RAC 245 04:29:55.244919 tst emergency_preemptive_call.py: using CellId 26000 04:29:55.362381 tst emergency_preemptive_call.py: using BVCI 26001 04:29:55.470038 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:55.480901 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:55.491615 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:55.502570 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:55.513577 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:29:55.524291 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:29:55.637976 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:29:55.756495 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:29:55.873177 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:29:55.989996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:56.486081 run create_hlr_db(pid=26490): Launched 04:29:56.615517 bus /sierra_2: Setting Powered False 04:29:57.678981 run create_hlr_db(pid=26490): Terminated: ok {rc=0} 04:29:58.107524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26492): Launched 04:29:58.406354 run osmo-hlr_10.42.42.2(pid=26493): Launched 04:29:58.519600 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:59.044409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26495): Launched 04:29:59.343858 run osmo-stp_10.42.42.5(pid=26496): Launched 04:29:59.467986 tst emergency_preemptive_call.py: using MSISDN 7550 04:29:59.622899 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:00.158270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26498): Launched 04:30:00.457464 run osmo-msc_10.42.42.6(pid=26499): Launched 04:30:00.624780 run osmo-stp_10.42.42.5(pid=26496): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26496)] 04:30:00.751472 run osmo-stp_10.42.42.5(pid=26496): stdout: | (launched: 2022-12-10_04:29:59.288391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:00.895725 run osmo-stp_10.42.42.5(pid=26496): stderr: | 20221210042959459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042959459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042959460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042959461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042959461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042959461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042959461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:01.030014 run osmo-stp_10.42.42.5(pid=26496): stdout: | (launched: 2022-12-10_04:29:59.288391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:01.152072 run osmo-stp_10.42.42.5(pid=26496): stderr: | 20221210042959459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210042959459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210042959460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210042959461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210042959461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210042959461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210042959461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:01.298768 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26496): Process ended prematurely: osmo-stp_10.42.42.5(pid=26496) [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26496)] [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 04:30:01.308239 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 04:30:01.338100 run osmo-hlr_10.42.42.2(pid=26493): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26493)] 04:30:01.388214 run osmo-hlr_10.42.42.2(pid=26493): stdout: | (launched: 2022-12-10_04:29:58.351152) 04:30:01.439960 run osmo-hlr_10.42.42.2(pid=26493): stderr: | 20221210042958529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210042958529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210042958529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210042958529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210042958529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210042958529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210042958541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210042958550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210042958550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210042958550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:01.519186 run osmo-msc_10.42.42.6(pid=26499): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26499)] 04:30:01.571832 run osmo-msc_10.42.42.6(pid=26499): stdout: | (launched: 2022-12-10_04:30:00.401929) 04:30:01.625735 run osmo-msc_10.42.42.6(pid=26499): stderr: | 20221210043000676 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043000676 DLGLOBAL DEBUG validating counter group 0x7f66ab88ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043000676 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043000676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043000677 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043000677 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043000679 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043000679 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043000679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043000679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:01.677763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26492): Terminating (SIGTERM) 04:30:01.727473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26495): Terminating (SIGTERM) 04:30:01.784864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26498): Terminating (SIGTERM) 04:30:01.849659 --- ParallelTerminationStrategy: PID 26492 died... 04:30:01.886804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26492): Terminated: ok {rc=0} 04:30:01.948923 --- ParallelTerminationStrategy: PID 26495 died... 04:30:01.969594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26495): Terminated: ok {rc=0} 04:30:02.017248 --- ParallelTerminationStrategy: PID 26498 died... 04:30:02.037205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26498): Terminated: ok {rc=0} 04:30:02.125734 bus /sierra_9: Setting Powered False 04:30:03.221816 bus /sierra_9: Setting Powered False 04:30:04.334406 bus /sierra_8: Setting Powered False 04:30:05.432502 bus /sierra_8: Setting Powered False 04:30:06.546307 bus /sierra_3: Setting Powered False 04:30:07.643755 bus /sierra_3: Setting Powered False 04:30:08.759555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 04:30:10.036277 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:30:10.041154 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:30:10.070714 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 04:30:10.110560 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 04:30:10.198184 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:30:10.228027 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 04:30:10.267718 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 04:30:10.861961 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 04:30:10.914645 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:10.925883 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:10.972183 tst cs_paging_gprs_active.py: using LAC 26001 04:30:11.100721 tst cs_paging_gprs_active.py: using RAC 246 04:30:11.228495 tst cs_paging_gprs_active.py: using CellId 26001 04:30:11.356488 tst cs_paging_gprs_active.py: using BVCI 26002 04:30:11.476049 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.487304 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.498392 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.509458 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.520244 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.531244 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.542874 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.553894 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:11.564865 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:11.680661 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:11.798172 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:30:12.019747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:30:12.347461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26507): Launched 04:30:12.630933 run iperf3-srv_10.42.42.10(pid=26508): Launched 04:30:12.753109 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:30:12.973053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:30:13.300269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26509): Launched 04:30:13.585052 run iperf3-srv_10.42.42.10(pid=26510): Launched 04:30:13.706858 tst cs_paging_gprs_active.py:38: start network... 04:30:13.926898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:14.431369 run create_hlr_db(pid=26511): Launched 04:30:14.562503 bus /sierra_2: Setting Powered False 04:30:15.626833 run create_hlr_db(pid=26511): Terminated: ok {rc=0} 04:30:16.089870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Launched 04:30:16.445733 run osmo-hlr_10.42.42.2(pid=26514): Launched 04:30:16.668610 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:17.297939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Launched 04:30:17.618964 run osmo-stp_10.42.42.5(pid=26517): Launched 04:30:17.737399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:30:18.265881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26519): Launched 04:30:18.382347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:30:18.640002 run patchelf(pid=26520): Launched 04:30:18.810450 run osmo-stp_10.42.42.5(pid=26517): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] 04:30:18.939854 run osmo-stp_10.42.42.5(pid=26517): stdout: | (launched: 2022-12-10_04:30:17.562608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:19.071340 run osmo-stp_10.42.42.5(pid=26517): stderr: | 20221210043017731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043017731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043017731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043017731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043017732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043017732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043017732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:19.203173 run osmo-stp_10.42.42.5(pid=26517): stdout: | (launched: 2022-12-10_04:30:17.562608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:19.328671 run osmo-stp_10.42.42.5(pid=26517): stderr: | 20221210043017731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043017731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043017731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043017731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043017732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043017732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043017732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:19.477113 run patchelf(pid=26520): Terminating (SIGINT) 04:30:19.649890 run patchelf(pid=26520): Terminated: ok {rc=0} 04:30:19.773781 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26517): Process ended prematurely: osmo-stp_10.42.42.5(pid=26517) [trial-2369↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] [trial-2369↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 04:30:19.783577 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:30:19.811743 run osmo-hlr_10.42.42.2(pid=26514): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26514)] 04:30:19.859341 run osmo-hlr_10.42.42.2(pid=26514): stdout: | (launched: 2022-12-10_04:30:16.379570) 04:30:19.908854 run osmo-hlr_10.42.42.2(pid=26514): stderr: | 20221210043016664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043016664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043016664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043016664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043016664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043016664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043016691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043016720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043016720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043016720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:19.958635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26507): Terminating (SIGTERM) 04:30:19.999203 run iperf3-srv_10.42.42.10(pid=26508): Terminating (SIGTERM) 04:30:20.039162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26509): Terminating (SIGTERM) 04:30:20.079032 run iperf3-srv_10.42.42.10(pid=26510): Terminating (SIGTERM) 04:30:20.118571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Terminating (SIGTERM) 04:30:20.158187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Terminating (SIGTERM) 04:30:20.197907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26519): Terminating (SIGTERM) 04:30:20.237983 --- ParallelTerminationStrategy: PID 26507 died... 04:30:20.257171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26507): Terminated: ok {rc=0} 04:30:20.301585 --- ParallelTerminationStrategy: PID 26508 died... 04:30:20.320024 run iperf3-srv_10.42.42.10(pid=26508): Terminated {rc=256} 04:30:20.365047 --- ParallelTerminationStrategy: PID 26509 died... 04:30:20.383709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26509): Terminated: ok {rc=0} 04:30:20.427892 --- ParallelTerminationStrategy: PID 26510 died... 04:30:20.446545 run iperf3-srv_10.42.42.10(pid=26510): Terminated {rc=256} 04:30:20.490781 --- ParallelTerminationStrategy: PID 26513 died... 04:30:20.509405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Terminated: ok {rc=0} 04:30:20.553649 --- ParallelTerminationStrategy: PID 26516 died... 04:30:20.572386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Terminated: ok {rc=0} 04:30:20.616603 --- ParallelTerminationStrategy: PID 26519 died... 04:30:20.635307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26519): Terminated: ok {rc=0} 04:30:20.721649 bus /gobi_0: Setting Powered False 04:30:21.821003 bus /gobi_0: Setting Powered False 04:30:22.935507 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 04:30:24.085420 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.097355 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:24.146455 tst iperf3.py: using LAC 26002 04:30:24.266080 tst iperf3.py: using RAC 247 04:30:24.387518 tst iperf3.py: using CellId 26002 04:30:24.506505 tst iperf3.py: using BVCI 26003 04:30:24.618429 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.629241 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.639906 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.650809 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.661526 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.672301 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.683461 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.694198 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:24.705334 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:24.820697 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:30:25.042417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:30:25.369685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26521): Launched 04:30:25.652666 run iperf3-srv_10.42.42.10(pid=26522): Launched 04:30:25.773997 tst iperf3.py:8: start network... 04:30:25.992940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:26.495110 run create_hlr_db(pid=26523): Launched 04:30:26.627053 bus /gobi_6: Setting Powered False 04:30:27.691347 run create_hlr_db(pid=26523): Terminated: ok {rc=0} 04:30:28.142190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26525): Launched 04:30:28.466506 run osmo-hlr_10.42.42.2(pid=26526): Launched 04:30:28.590662 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:29.151448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26528): Launched 04:30:29.476439 run osmo-stp_10.42.42.5(pid=26529): Launched 04:30:29.599493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:30:30.158561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26531): Launched 04:30:30.284585 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:30:30.558356 run patchelf(pid=26532): Launched 04:30:30.737925 run osmo-stp_10.42.42.5(pid=26529): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26529)] 04:30:30.883133 run osmo-stp_10.42.42.5(pid=26529): stdout: | (launched: 2022-12-10_04:30:29.416772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:31.026037 run osmo-stp_10.42.42.5(pid=26529): stderr: | 20221210043029612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043029612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043029613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043029613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043029613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043029613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043029614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:31.167301 run osmo-stp_10.42.42.5(pid=26529): stdout: | (launched: 2022-12-10_04:30:29.416772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:31.297175 run osmo-stp_10.42.42.5(pid=26529): stderr: | 20221210043029612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043029612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043029613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043029613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043029613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043029613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043029614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:31.470389 run patchelf(pid=26532): Terminating (SIGINT) 04:30:31.657107 run patchelf(pid=26532): Terminated: ok {rc=0} 04:30:31.785982 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26529): Process ended prematurely: osmo-stp_10.42.42.5(pid=26529) [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26529)] [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 04:30:31.796694 tst iperf3.py:8: Test FAILED (7.7 sec) 04:30:31.828893 run osmo-hlr_10.42.42.2(pid=26526): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26526)] 04:30:31.879516 run osmo-hlr_10.42.42.2(pid=26526): stdout: | (launched: 2022-12-10_04:30:28.407083) 04:30:31.942990 run osmo-hlr_10.42.42.2(pid=26526): stderr: | 20221210043028607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043028607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043028607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043028607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043028607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043028607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043028620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043028628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043028628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043028628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:32.006551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26521): Terminating (SIGTERM) 04:30:32.055322 run iperf3-srv_10.42.42.10(pid=26522): Terminating (SIGTERM) 04:30:32.100405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26525): Terminating (SIGTERM) 04:30:32.144902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26528): Terminating (SIGTERM) 04:30:32.188922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26531): Terminating (SIGTERM) 04:30:32.233344 --- ParallelTerminationStrategy: PID 26521 died... 04:30:32.253384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26521): Terminated: ok {rc=0} 04:30:32.302274 --- ParallelTerminationStrategy: PID 26522 died... 04:30:32.321829 run iperf3-srv_10.42.42.10(pid=26522): Terminated {rc=256} 04:30:32.370403 --- ParallelTerminationStrategy: PID 26525 died... 04:30:32.390928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26525): Terminated: ok {rc=0} 04:30:32.435502 --- ParallelTerminationStrategy: PID 26528 died... 04:30:32.454256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26528): Terminated: ok {rc=0} 04:30:32.498899 --- ParallelTerminationStrategy: PID 26531 died... 04:30:32.517671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26531): Terminated: ok {rc=0} 04:30:32.604222 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 04:30:33.751718 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:33.763191 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:33.808265 tst iperf3m4.py: using LAC 26003 04:30:33.929312 tst iperf3m4.py: using RAC 248 04:30:34.048522 tst iperf3m4.py: using CellId 26003 04:30:34.168291 tst iperf3m4.py: using BVCI 26004 04:30:34.280223 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.291332 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.301950 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.312899 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.323970 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.334862 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.346143 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.357132 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:34.368230 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:34.488433 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:34.606326 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:34.722948 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:34.845374 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:30:35.051708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:30:35.359049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26533): Launched 04:30:35.624843 run iperf3-srv_10.42.42.10(pid=26534): Launched 04:30:35.740220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:30:35.945648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:30:36.251502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26535): Launched 04:30:36.516408 run iperf3-srv_10.42.42.10(pid=26536): Launched 04:30:36.630564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:30:36.834976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:30:37.141206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26537): Launched 04:30:37.406364 run iperf3-srv_10.42.42.10(pid=26538): Launched 04:30:37.520451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:30:37.725398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:30:38.032097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26539): Launched 04:30:38.298354 run iperf3-srv_10.42.42.10(pid=26540): Launched 04:30:38.412665 tst iperf3m4.py:8: start network... 04:30:38.617174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:39.088429 run create_hlr_db(pid=26541): Launched 04:30:39.204837 bus /gobi_6: Setting Powered False 04:30:40.266319 run create_hlr_db(pid=26541): Terminated: ok {rc=0} 04:30:40.710082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26543): Launched 04:30:41.034671 run osmo-hlr_10.42.42.2(pid=26544): Launched 04:30:41.157937 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:41.820465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26546): Launched 04:30:42.139584 run osmo-stp_10.42.42.5(pid=26548): Launched 04:30:42.259802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:30:42.810599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26550): Launched 04:30:42.931673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:30:43.200171 run patchelf(pid=26551): Launched 04:30:43.377453 run osmo-stp_10.42.42.5(pid=26548): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26548)] 04:30:43.512272 run osmo-stp_10.42.42.5(pid=26548): stdout: | (launched: 2022-12-10_04:30:42.081267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:43.649064 run osmo-stp_10.42.42.5(pid=26548): stderr: | 20221210043042272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043042272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043042272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043042272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043042275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043042275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043042275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:43.785981 run osmo-stp_10.42.42.5(pid=26548): stdout: | (launched: 2022-12-10_04:30:42.081267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:43.916706 run osmo-stp_10.42.42.5(pid=26548): stderr: | 20221210043042272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043042272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043042272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043042272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043042275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043042275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043042275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:44.071133 run patchelf(pid=26551): Terminating (SIGINT) 04:30:44.249527 run patchelf(pid=26551): Terminated: ok {rc=0} 04:30:44.379194 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26548): Process ended prematurely: osmo-stp_10.42.42.5(pid=26548) [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26548)] [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 04:30:44.389667 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:30:44.418540 run osmo-hlr_10.42.42.2(pid=26544): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26544)] 04:30:44.468070 run osmo-hlr_10.42.42.2(pid=26544): stdout: | (launched: 2022-12-10_04:30:40.975127) 04:30:44.519313 run osmo-hlr_10.42.42.2(pid=26544): stderr: | 20221210043041173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043041173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043041174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043041174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043041174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043041174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043041186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043041197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043041197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043041197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:44.570582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26533): Terminating (SIGTERM) 04:30:44.612305 run iperf3-srv_10.42.42.10(pid=26534): Terminating (SIGTERM) 04:30:44.653543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26535): Terminating (SIGTERM) 04:30:44.694605 run iperf3-srv_10.42.42.10(pid=26536): Terminating (SIGTERM) 04:30:44.735811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26537): Terminating (SIGTERM) 04:30:44.777005 run iperf3-srv_10.42.42.10(pid=26538): Terminating (SIGTERM) 04:30:44.817964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26539): Terminating (SIGTERM) 04:30:44.859078 run iperf3-srv_10.42.42.10(pid=26540): Terminating (SIGTERM) 04:30:44.900266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26543): Terminating (SIGTERM) 04:30:44.941710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26546): Terminating (SIGTERM) 04:30:44.982931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26550): Terminating (SIGTERM) 04:30:45.024497 --- ParallelTerminationStrategy: PID 26533 died... 04:30:45.044432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26533): Terminated: ok {rc=0} 04:30:45.090478 --- ParallelTerminationStrategy: PID 26534 died... 04:30:45.110113 run iperf3-srv_10.42.42.10(pid=26534): Terminated {rc=256} 04:30:45.155902 --- ParallelTerminationStrategy: PID 26535 died... 04:30:45.175326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26535): Terminated: ok {rc=0} 04:30:45.221018 --- ParallelTerminationStrategy: PID 26536 died... 04:30:45.240412 run iperf3-srv_10.42.42.10(pid=26536): Terminated {rc=256} 04:30:45.286544 --- ParallelTerminationStrategy: PID 26537 died... 04:30:45.306022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26537): Terminated: ok {rc=0} 04:30:45.351971 --- ParallelTerminationStrategy: PID 26538 died... 04:30:45.371345 run iperf3-srv_10.42.42.10(pid=26538): Terminated {rc=256} 04:30:45.417083 --- ParallelTerminationStrategy: PID 26539 died... 04:30:45.436533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26539): Terminated: ok {rc=0} 04:30:45.482294 --- ParallelTerminationStrategy: PID 26540 died... 04:30:45.501803 run iperf3-srv_10.42.42.10(pid=26540): Terminated {rc=256} 04:30:45.547396 --- ParallelTerminationStrategy: PID 26543 died... 04:30:45.566931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26543): Terminated: ok {rc=0} 04:30:45.612504 --- ParallelTerminationStrategy: PID 26546 died... 04:30:45.631796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26546): Terminated: ok {rc=0} 04:30:45.677340 --- ParallelTerminationStrategy: PID 26550 died... 04:30:45.696681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26550): Terminated: ok {rc=0} 04:30:45.784418 bus /gobi_4: Setting Powered False 04:30:46.887308 bus /gobi_4: Setting Powered False 04:30:48.004835 bus /gobi_1: Setting Powered False 04:30:49.102036 bus /gobi_1: Setting Powered False 04:30:50.216678 bus /gobi_0: Setting Powered False 04:30:51.314023 bus /gobi_0: Setting Powered False 04:30:52.430366 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 04:30:53.533423 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:53.545340 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:53.591466 tst ping.py: using LAC 26004 04:30:53.715640 tst ping.py: using RAC 249 04:30:53.838984 tst ping.py: using CellId 26004 04:30:53.966933 tst ping.py: using BVCI 26005 04:30:54.082177 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:54.093453 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:54.104418 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:54.115504 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:54.126435 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:54.137461 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:54.148524 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:30:54.159466 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:54.276441 tst ping.py:19: start network... 04:30:54.487241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:54.971514 run create_hlr_db(pid=26552): Launched 04:30:55.098278 bus /gobi_6: Setting Powered False 04:30:56.160217 run create_hlr_db(pid=26552): Terminated: ok {rc=0} 04:30:56.582705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26554): Launched 04:30:56.877654 run osmo-hlr_10.42.42.2(pid=26555): Launched 04:30:56.989523 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:57.518293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26557): Launched 04:30:57.812568 run osmo-stp_10.42.42.5(pid=26558): Launched 04:30:57.925126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:30:58.432108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26560): Launched 04:30:58.544439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:30:58.792820 run patchelf(pid=26561): Launched 04:30:58.956926 run osmo-stp_10.42.42.5(pid=26558): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26558)] 04:30:59.081856 run osmo-stp_10.42.42.5(pid=26558): stdout: | (launched: 2022-12-10_04:30:57.758440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:59.208168 run osmo-stp_10.42.42.5(pid=26558): stderr: | 20221210043057927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043057928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043057928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043057928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043057929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043057929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043057929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:59.334602 run osmo-stp_10.42.42.5(pid=26558): stdout: | (launched: 2022-12-10_04:30:57.758440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:59.455527 run osmo-stp_10.42.42.5(pid=26558): stderr: | 20221210043057927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043057928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043057928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043057928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043057929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043057929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043057929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:59.598536 run patchelf(pid=26561): Terminating (SIGINT) 04:30:59.763879 run patchelf(pid=26561): Terminated: ok {rc=0} 04:30:59.884022 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26558): Process ended prematurely: osmo-stp_10.42.42.5(pid=26558) [trial-2369↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26558)] [trial-2369↪gprs:trx-lms-limenet-micro↪ping.py:22] 04:30:59.893157 tst ping.py:22: Test FAILED (6.4 sec) 04:30:59.920045 run osmo-hlr_10.42.42.2(pid=26555): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26555)] 04:30:59.967468 run osmo-hlr_10.42.42.2(pid=26555): stdout: | (launched: 2022-12-10_04:30:56.823249) 04:31:00.016607 run osmo-hlr_10.42.42.2(pid=26555): stderr: | 20221210043056997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043056997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043056997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043056997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043056998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043056998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043057008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043057017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043057017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043057017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:00.066282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26554): Terminating (SIGTERM) 04:31:00.105938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26557): Terminating (SIGTERM) 04:31:00.145659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26560): Terminating (SIGTERM) 04:31:00.185493 --- ParallelTerminationStrategy: PID 26554 died... 04:31:00.204327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26554): Terminated: ok {rc=0} 04:31:00.248913 --- ParallelTerminationStrategy: PID 26557 died... 04:31:00.267432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26557): Terminated: ok {rc=0} 04:31:00.311323 --- ParallelTerminationStrategy: PID 26560 died... 04:31:00.329841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26560): Terminated: ok {rc=0} 04:31:00.415421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 04:31:01.512749 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:01.525840 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:01.575817 tst ping_idle_ping.py: using LAC 26005 04:31:01.740296 tst ping_idle_ping.py: using RAC 250 04:31:01.868076 tst ping_idle_ping.py: using CellId 26005 04:31:01.989291 tst ping_idle_ping.py: using BVCI 26006 04:31:02.104371 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:02.116436 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:02.129461 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:02.143103 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:02.154611 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:02.168340 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:02.181278 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:02.192819 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:02.311088 tst ping_idle_ping.py:24: start network... 04:31:02.510799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:02.970846 run create_hlr_db(pid=26562): Launched 04:31:03.082917 bus /gobi_6: Setting Powered False 04:31:04.141992 run create_hlr_db(pid=26562): Terminated: ok {rc=0} 04:31:04.572719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26564): Launched 04:31:04.887355 run osmo-hlr_10.42.42.2(pid=26565): Launched 04:31:05.007548 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:05.553415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26567): Launched 04:31:05.867345 run osmo-stp_10.42.42.5(pid=26568): Launched 04:31:05.987163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:06.530717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26570): Launched 04:31:06.650470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:06.914973 run patchelf(pid=26571): Launched 04:31:07.089139 run osmo-stp_10.42.42.5(pid=26568): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26568)] 04:31:07.222875 run osmo-stp_10.42.42.5(pid=26568): stdout: | (launched: 2022-12-10_04:31:05.810001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:07.358296 run osmo-stp_10.42.42.5(pid=26568): stderr: | 20221210043105999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043105999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043106000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043106000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043106001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043106001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043106001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:07.493243 run osmo-stp_10.42.42.5(pid=26568): stdout: | (launched: 2022-12-10_04:31:05.810001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:07.622377 run osmo-stp_10.42.42.5(pid=26568): stderr: | 20221210043105999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043105999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043106000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043106000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043106001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043106001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043106001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:07.775245 run patchelf(pid=26571): Terminating (SIGINT) 04:31:07.951489 run patchelf(pid=26571): Terminated: ok {rc=0} 04:31:08.078364 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26568): Process ended prematurely: osmo-stp_10.42.42.5(pid=26568) [trial-2369↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26568)] [trial-2369↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 04:31:08.087984 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:31:08.115856 run osmo-hlr_10.42.42.2(pid=26565): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26565)] 04:31:08.165196 run osmo-hlr_10.42.42.2(pid=26565): stdout: | (launched: 2022-12-10_04:31:04.829997) 04:31:08.216180 run osmo-hlr_10.42.42.2(pid=26565): stderr: | 20221210043105028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043105028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043105028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043105028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043105028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043105028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043105041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043105049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043105049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043105050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:08.267614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26564): Terminating (SIGTERM) 04:31:08.309380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26567): Terminating (SIGTERM) 04:31:08.350989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26570): Terminating (SIGTERM) 04:31:08.392661 --- ParallelTerminationStrategy: PID 26564 died... 04:31:08.412544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26564): Terminated: ok {rc=0} 04:31:08.458460 --- ParallelTerminationStrategy: PID 26567 died... 04:31:08.477967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26567): Terminated: ok {rc=0} 04:31:08.523472 --- ParallelTerminationStrategy: PID 26570 died... 04:31:08.542846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26570): Terminated: ok {rc=0} 04:31:08.629692 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 04:31:09.930990 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:31:09.937276 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:31:09.967487 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:31:10.007020 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:31:10.096939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:31:10.126139 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:31:10.164227 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:31:10.763181 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:31:10.814946 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:10.826529 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:31:10.877251 tst cs_paging_gprs_active.py: using LAC 26006 04:31:11.000637 tst cs_paging_gprs_active.py: using RAC 251 04:31:11.124152 tst cs_paging_gprs_active.py: using CellId 26006 04:31:11.249187 tst cs_paging_gprs_active.py: using BVCI 26007 04:31:11.365360 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.376881 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.388167 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.399424 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.412220 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.423553 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.435443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.446826 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:11.458447 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:11.574123 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:11.693312 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:31:11.910980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:12.233084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Launched 04:31:12.512087 run iperf3-srv_10.42.42.10(pid=26576): Launched 04:31:12.633433 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:31:12.850255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:13.171698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26577): Launched 04:31:13.450395 run iperf3-srv_10.42.42.10(pid=26578): Launched 04:31:13.570464 tst cs_paging_gprs_active.py:38: start network... 04:31:13.786858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:14.283708 run create_hlr_db(pid=26579): Launched 04:31:14.413980 bus /gobi_6: Setting Powered False 04:31:15.477500 run create_hlr_db(pid=26579): Terminated: ok {rc=0} 04:31:15.927667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26581): Launched 04:31:16.255852 run osmo-hlr_10.42.42.2(pid=26582): Launched 04:31:16.485416 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:17.133699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26584): Launched 04:31:17.464284 run osmo-stp_10.42.42.5(pid=26585): Launched 04:31:17.587893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:18.143338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26587): Launched 04:31:18.265426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:18.536393 run patchelf(pid=26588): Launched 04:31:18.714311 run osmo-stp_10.42.42.5(pid=26585): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26585)] 04:31:18.849772 run osmo-stp_10.42.42.5(pid=26585): stdout: | (launched: 2022-12-10_04:31:17.405902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:18.987199 run osmo-stp_10.42.42.5(pid=26585): stderr: | 20221210043117599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043117599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043117599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043117600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043117600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043117600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043117600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:19.124563 run osmo-stp_10.42.42.5(pid=26585): stdout: | (launched: 2022-12-10_04:31:17.405902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:19.255815 run osmo-stp_10.42.42.5(pid=26585): stderr: | 20221210043117599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043117599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043117599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043117600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043117600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043117600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043117600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:19.411542 run patchelf(pid=26588): Terminating (SIGINT) 04:31:19.591455 run patchelf(pid=26588): Terminated: ok {rc=0} 04:31:19.721146 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26585): Process ended prematurely: osmo-stp_10.42.42.5(pid=26585) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26585)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:31:19.731559 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 04:31:19.760119 run osmo-hlr_10.42.42.2(pid=26582): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26582)] 04:31:19.809803 run osmo-hlr_10.42.42.2(pid=26582): stdout: | (launched: 2022-12-10_04:31:16.190222) 04:31:19.861096 run osmo-hlr_10.42.42.2(pid=26582): stderr: | 20221210043116554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043116554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043116554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043116554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043116554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043116554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043116572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043116588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043116588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043116589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:19.912650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminating (SIGTERM) 04:31:19.954179 run iperf3-srv_10.42.42.10(pid=26576): Terminating (SIGTERM) 04:31:19.995952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26577): Terminating (SIGTERM) 04:31:20.037733 run iperf3-srv_10.42.42.10(pid=26578): Terminating (SIGTERM) 04:31:20.079330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26581): Terminating (SIGTERM) 04:31:20.120846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26584): Terminating (SIGTERM) 04:31:20.162301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26587): Terminating (SIGTERM) 04:31:20.203994 --- ParallelTerminationStrategy: PID 26575 died... 04:31:20.223808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminated: ok {rc=0} 04:31:20.269855 --- ParallelTerminationStrategy: PID 26576 died... 04:31:20.289476 run iperf3-srv_10.42.42.10(pid=26576): Terminated {rc=256} 04:31:20.335329 --- ParallelTerminationStrategy: PID 26577 died... 04:31:20.354868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26577): Terminated: ok {rc=0} 04:31:20.400489 --- ParallelTerminationStrategy: PID 26578 died... 04:31:20.419752 run iperf3-srv_10.42.42.10(pid=26578): Terminated {rc=256} 04:31:20.465410 --- ParallelTerminationStrategy: PID 26581 died... 04:31:20.484895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26581): Terminated: ok {rc=0} 04:31:20.530724 --- ParallelTerminationStrategy: PID 26584 died... 04:31:20.550230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26584): Terminated: ok {rc=0} 04:31:20.596093 --- ParallelTerminationStrategy: PID 26587 died... 04:31:20.615689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26587): Terminated: ok {rc=0} 04:31:20.702687 bus /gobi_0: Setting Powered False 04:31:21.800862 bus /gobi_0: Setting Powered False 04:31:22.914413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:31:24.062188 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.074399 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:31:24.122128 tst iperf3.py: using LAC 26007 04:31:24.248539 tst iperf3.py: using RAC 252 04:31:24.375988 tst iperf3.py: using CellId 26007 04:31:24.502468 tst iperf3.py: using BVCI 26008 04:31:24.618640 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.630292 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.641707 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.653037 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.664291 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.675643 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.687159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.698418 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:24.709975 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:24.826571 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:31:25.042851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:25.363749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26589): Launched 04:31:25.641292 run iperf3-srv_10.42.42.10(pid=26590): Launched 04:31:25.760831 tst iperf3.py:8: start network... 04:31:25.976195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:26.470284 run create_hlr_db(pid=26591): Launched 04:31:26.600330 bus /gobi_6: Setting Powered False 04:31:27.664309 run create_hlr_db(pid=26591): Terminated: ok {rc=0} 04:31:28.109039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26593): Launched 04:31:28.429528 run osmo-hlr_10.42.42.2(pid=26594): Launched 04:31:28.551246 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:29.101951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26596): Launched 04:31:29.420465 run osmo-stp_10.42.42.5(pid=26597): Launched 04:31:29.541811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:30.092535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26599): Launched 04:31:30.214926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:30.485502 run patchelf(pid=26600): Launched 04:31:30.662226 run osmo-stp_10.42.42.5(pid=26597): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26597)] 04:31:30.797291 run osmo-stp_10.42.42.5(pid=26597): stdout: | (launched: 2022-12-10_04:31:29.362452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:30.951485 run osmo-stp_10.42.42.5(pid=26597): stderr: | 20221210043129555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043129555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043129555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043129555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043129556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043129556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043129556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:31.090929 run osmo-stp_10.42.42.5(pid=26597): stdout: | (launched: 2022-12-10_04:31:29.362452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:31.224093 run osmo-stp_10.42.42.5(pid=26597): stderr: | 20221210043129555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043129555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043129555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043129555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043129556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043129556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043129556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:31.382950 run patchelf(pid=26600): Terminating (SIGINT) 04:31:31.565691 run patchelf(pid=26600): Terminated: ok {rc=0} 04:31:31.696834 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26597): Process ended prematurely: osmo-stp_10.42.42.5(pid=26597) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26597)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 04:31:31.707755 tst iperf3.py:8: Test FAILED (7.7 sec) 04:31:31.737203 run osmo-hlr_10.42.42.2(pid=26594): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26594)] 04:31:31.788277 run osmo-hlr_10.42.42.2(pid=26594): stdout: | (launched: 2022-12-10_04:31:28.370942) 04:31:31.840801 run osmo-hlr_10.42.42.2(pid=26594): stderr: | 20221210043128569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043128570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043128570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043128570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043128570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043128570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043128582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043128592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043128593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043128593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:31.905042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26589): Terminating (SIGTERM) 04:31:31.956387 run iperf3-srv_10.42.42.10(pid=26590): Terminating (SIGTERM) 04:31:32.012884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26593): Terminating (SIGTERM) 04:31:32.066194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26596): Terminating (SIGTERM) 04:31:32.118997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26599): Terminating (SIGTERM) 04:31:32.163293 --- ParallelTerminationStrategy: PID 26589 died... 04:31:32.183382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26589): Terminated: ok {rc=0} 04:31:32.231778 --- ParallelTerminationStrategy: PID 26590 died... 04:31:32.250480 run iperf3-srv_10.42.42.10(pid=26590): Terminated {rc=256} 04:31:32.295170 --- ParallelTerminationStrategy: PID 26593 died... 04:31:32.313834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26593): Terminated: ok {rc=0} 04:31:32.358395 --- ParallelTerminationStrategy: PID 26596 died... 04:31:32.377143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26596): Terminated: ok {rc=0} 04:31:32.421382 --- ParallelTerminationStrategy: PID 26599 died... 04:31:32.439977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26599): Terminated: ok {rc=0} 04:31:32.523046 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:31:33.672389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:33.684684 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:31:33.731759 tst iperf3m4.py: using LAC 26008 04:31:33.856907 tst iperf3m4.py: using RAC 253 04:31:33.980725 tst iperf3m4.py: using CellId 26008 04:31:34.103716 tst iperf3m4.py: using BVCI 26009 04:31:34.219797 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.231500 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.243013 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.254669 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.266085 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.277496 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.288907 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.300595 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:34.312200 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:34.433175 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:34.548033 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:34.666431 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:34.785455 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:31:35.002035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:35.322838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26601): Launched 04:31:35.601469 run iperf3-srv_10.42.42.10(pid=26602): Launched 04:31:35.720609 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:31:35.936310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:36.257257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26603): Launched 04:31:36.534797 run iperf3-srv_10.42.42.10(pid=26604): Launched 04:31:36.654019 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:31:36.870222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:37.191191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26605): Launched 04:31:37.469467 run iperf3-srv_10.42.42.10(pid=26606): Launched 04:31:37.589655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:31:37.805915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:38.126016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26607): Launched 04:31:38.404550 run iperf3-srv_10.42.42.10(pid=26608): Launched 04:31:38.523560 tst iperf3m4.py:8: start network... 04:31:38.739213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:39.233434 run create_hlr_db(pid=26609): Launched 04:31:39.362189 bus /gobi_6: Setting Powered False 04:31:40.425250 run create_hlr_db(pid=26609): Terminated: ok {rc=0} 04:31:40.868766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26611): Launched 04:31:41.187273 run osmo-hlr_10.42.42.2(pid=26612): Launched 04:31:41.308554 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:41.859035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26614): Launched 04:31:42.179567 run osmo-stp_10.42.42.5(pid=26615): Launched 04:31:42.301661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:42.852774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26617): Launched 04:31:42.974919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:43.244823 run patchelf(pid=26618): Launched 04:31:43.422473 run osmo-stp_10.42.42.5(pid=26615): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26615)] 04:31:43.558194 run osmo-stp_10.42.42.5(pid=26615): stdout: | (launched: 2022-12-10_04:31:42.120416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:43.695271 run osmo-stp_10.42.42.5(pid=26615): stderr: | 20221210043142311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043142311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043142311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043142312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043142312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043142312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043142312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:43.832233 run osmo-stp_10.42.42.5(pid=26615): stdout: | (launched: 2022-12-10_04:31:42.120416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:43.963279 run osmo-stp_10.42.42.5(pid=26615): stderr: | 20221210043142311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043142311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043142311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043142312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043142312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043142312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043142312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:44.118316 run patchelf(pid=26618): Terminating (SIGINT) 04:31:44.298420 run patchelf(pid=26618): Terminated: ok {rc=0} 04:31:44.428249 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26615): Process ended prematurely: osmo-stp_10.42.42.5(pid=26615) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26615)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 04:31:44.438848 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:31:44.467578 run osmo-hlr_10.42.42.2(pid=26612): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26612)] 04:31:44.517226 run osmo-hlr_10.42.42.2(pid=26612): stdout: | (launched: 2022-12-10_04:31:41.129015) 04:31:44.568456 run osmo-hlr_10.42.42.2(pid=26612): stderr: | 20221210043141326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043141326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043141326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043141326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043141326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043141326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043141340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043141350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043141350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043141350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:44.619970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26601): Terminating (SIGTERM) 04:31:44.661543 run iperf3-srv_10.42.42.10(pid=26602): Terminating (SIGTERM) 04:31:44.702919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26603): Terminating (SIGTERM) 04:31:44.744368 run iperf3-srv_10.42.42.10(pid=26604): Terminating (SIGTERM) 04:31:44.785854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26605): Terminating (SIGTERM) 04:31:44.827278 run iperf3-srv_10.42.42.10(pid=26606): Terminating (SIGTERM) 04:31:44.868522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26607): Terminating (SIGTERM) 04:31:44.909969 run iperf3-srv_10.42.42.10(pid=26608): Terminating (SIGTERM) 04:31:44.951152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26611): Terminating (SIGTERM) 04:31:44.992355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26614): Terminating (SIGTERM) 04:31:45.033546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26617): Terminating (SIGTERM) 04:31:45.074931 --- ParallelTerminationStrategy: PID 26601 died... 04:31:45.094665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26601): Terminated: ok {rc=0} 04:31:45.140397 --- ParallelTerminationStrategy: PID 26602 died... 04:31:45.159556 run iperf3-srv_10.42.42.10(pid=26602): Terminated {rc=256} 04:31:45.205240 --- ParallelTerminationStrategy: PID 26603 died... 04:31:45.224381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26603): Terminated: ok {rc=0} 04:31:45.269803 --- ParallelTerminationStrategy: PID 26604 died... 04:31:45.289103 run iperf3-srv_10.42.42.10(pid=26604): Terminated {rc=256} 04:31:45.334997 --- ParallelTerminationStrategy: PID 26605 died... 04:31:45.354441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26605): Terminated: ok {rc=0} 04:31:45.399847 --- ParallelTerminationStrategy: PID 26606 died... 04:31:45.419057 run iperf3-srv_10.42.42.10(pid=26606): Terminated {rc=256} 04:31:45.464413 --- ParallelTerminationStrategy: PID 26607 died... 04:31:45.483835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26607): Terminated: ok {rc=0} 04:31:45.529273 --- ParallelTerminationStrategy: PID 26608 died... 04:31:45.548480 run iperf3-srv_10.42.42.10(pid=26608): Terminated {rc=256} 04:31:45.594028 --- ParallelTerminationStrategy: PID 26611 died... 04:31:45.613434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26611): Terminated: ok {rc=0} 04:31:45.658783 --- ParallelTerminationStrategy: PID 26614 died... 04:31:45.678242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26614): Terminated: ok {rc=0} 04:31:45.723719 --- ParallelTerminationStrategy: PID 26617 died... 04:31:45.743098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26617): Terminated: ok {rc=0} 04:31:45.833222 bus /gobi_4: Setting Powered False 04:31:46.950509 bus /gobi_4: Setting Powered False 04:31:48.066327 bus /gobi_1: Setting Powered False 04:31:49.164644 bus /gobi_1: Setting Powered False 04:31:50.280392 bus /gobi_0: Setting Powered False 04:31:51.378700 bus /gobi_0: Setting Powered False 04:31:52.497513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 04:31:53.600335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:53.612241 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:31:53.662439 tst ping.py: using LAC 26009 04:31:53.779692 tst ping.py: using RAC 254 04:31:53.895044 tst ping.py: using CellId 26009 04:31:54.013442 tst ping.py: using BVCI 26010 04:31:54.122108 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:54.133400 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:54.144208 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:54.156033 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:54.167909 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:54.179874 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:54.191866 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:31:54.203406 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:31:54.319304 tst ping.py:19: start network... 04:31:54.532524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:55.017679 run create_hlr_db(pid=26619): Launched 04:31:55.145986 bus /gobi_6: Setting Powered False 04:31:56.207933 run create_hlr_db(pid=26619): Terminated: ok {rc=0} 04:31:56.630673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26621): Launched 04:31:56.924732 run osmo-hlr_10.42.42.2(pid=26622): Launched 04:31:57.036767 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:57.561930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26624): Launched 04:31:57.856467 run osmo-stp_10.42.42.5(pid=26625): Launched 04:31:57.968192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:58.482957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26627): Launched 04:31:58.596071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:58.846243 run patchelf(pid=26628): Launched 04:31:59.010188 run osmo-stp_10.42.42.5(pid=26625): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26625)] 04:31:59.135832 run osmo-stp_10.42.42.5(pid=26625): stdout: | (launched: 2022-12-10_04:31:57.802025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:59.263099 run osmo-stp_10.42.42.5(pid=26625): stderr: | 20221210043157971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043157971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043157972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043157972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043157974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043157974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043157974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:59.390365 run osmo-stp_10.42.42.5(pid=26625): stdout: | (launched: 2022-12-10_04:31:57.802025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:59.511476 run osmo-stp_10.42.42.5(pid=26625): stderr: | 20221210043157971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043157971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043157972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043157972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043157974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043157974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043157974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:59.655073 run patchelf(pid=26628): Terminating (SIGINT) 04:31:59.821211 run patchelf(pid=26628): Terminated: ok {rc=0} 04:31:59.941446 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26625): Process ended prematurely: osmo-stp_10.42.42.5(pid=26625) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26625)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 04:31:59.950500 tst ping.py:22: Test FAILED (6.3 sec) 04:31:59.977843 run osmo-hlr_10.42.42.2(pid=26622): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26622)] 04:32:00.025529 run osmo-hlr_10.42.42.2(pid=26622): stdout: | (launched: 2022-12-10_04:31:56.870696) 04:32:00.075112 run osmo-hlr_10.42.42.2(pid=26622): stderr: | 20221210043157047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043157047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043157047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043157047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043157047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043157047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043157060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043157070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043157070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043157070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:00.125443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26621): Terminating (SIGTERM) 04:32:00.165588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26624): Terminating (SIGTERM) 04:32:00.205493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26627): Terminating (SIGTERM) 04:32:00.245877 --- ParallelTerminationStrategy: PID 26621 died... 04:32:00.265083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26621): Terminated: ok {rc=0} 04:32:00.309995 --- ParallelTerminationStrategy: PID 26624 died... 04:32:00.328622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26624): Terminated: ok {rc=0} 04:32:00.373350 --- ParallelTerminationStrategy: PID 26627 died... 04:32:00.391897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26627): Terminated: ok {rc=0} 04:32:00.478005 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:32:01.567836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:01.580493 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:01.638971 tst ping_idle_ping.py: using LAC 26010 04:32:01.789249 tst ping_idle_ping.py: using RAC 255 04:32:01.942940 tst ping_idle_ping.py: using CellId 26010 04:32:02.092837 tst ping_idle_ping.py: using BVCI 26011 04:32:02.217436 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:02.229604 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:02.241433 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:02.255195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:02.266960 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:02.280779 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:02.294138 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:02.305939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:02.426527 tst ping_idle_ping.py:24: start network... 04:32:02.642350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:03.132394 run create_hlr_db(pid=26629): Launched 04:32:03.260588 bus /gobi_6: Setting Powered False 04:32:04.323908 run create_hlr_db(pid=26629): Terminated: ok {rc=0} 04:32:04.750048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26631): Launched 04:32:05.045517 run osmo-hlr_10.42.42.2(pid=26632): Launched 04:32:05.158312 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:05.675227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26634): Launched 04:32:05.971074 run osmo-stp_10.42.42.5(pid=26635): Launched 04:32:06.083578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:06.593501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26637): Launched 04:32:06.706292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:06.955777 run patchelf(pid=26638): Launched 04:32:07.120339 run osmo-stp_10.42.42.5(pid=26635): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26635)] 04:32:07.245951 run osmo-stp_10.42.42.5(pid=26635): stdout: | (launched: 2022-12-10_04:32:05.916036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:07.373220 run osmo-stp_10.42.42.5(pid=26635): stderr: | 20221210043206086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043206086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043206086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043206086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043206087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043206087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043206087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:07.500502 run osmo-stp_10.42.42.5(pid=26635): stdout: | (launched: 2022-12-10_04:32:05.916036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:07.621827 run osmo-stp_10.42.42.5(pid=26635): stderr: | 20221210043206086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043206086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043206086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043206086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043206087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043206087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043206087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:07.765936 run patchelf(pid=26638): Terminating (SIGINT) 04:32:07.931764 run patchelf(pid=26638): Terminated: ok {rc=0} 04:32:08.051724 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26635): Process ended prematurely: osmo-stp_10.42.42.5(pid=26635) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26635)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 04:32:08.060840 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:32:08.088097 run osmo-hlr_10.42.42.2(pid=26632): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26632)] 04:32:08.135668 run osmo-hlr_10.42.42.2(pid=26632): stdout: | (launched: 2022-12-10_04:32:04.991386) 04:32:08.184886 run osmo-hlr_10.42.42.2(pid=26632): stderr: | 20221210043205167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043205167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043205167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043205167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043205167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043205167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043205179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043205190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043205191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043205191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:08.234694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26631): Terminating (SIGTERM) 04:32:08.274465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26634): Terminating (SIGTERM) 04:32:08.314296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26637): Terminating (SIGTERM) 04:32:08.354237 --- ParallelTerminationStrategy: PID 26631 died... 04:32:08.373395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26631): Terminated: ok {rc=0} 04:32:08.417539 --- ParallelTerminationStrategy: PID 26634 died... 04:32:08.435865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26634): Terminated: ok {rc=0} 04:32:08.480447 --- ParallelTerminationStrategy: PID 26637 died... 04:32:08.498984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26637): Terminated: ok {rc=0} 04:32:08.585100 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:32:09.881064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:32:09.887138 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:32:09.916930 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:32:09.955260 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:32:10.042839 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:32:10.072319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:32:10.110653 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:32:10.704498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:32:10.753580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:10.764506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:32:10.829563 tst cs_paging_gprs_active.py: using LAC 26011 04:32:10.956677 tst cs_paging_gprs_active.py: using RAC 1 04:32:11.082752 tst cs_paging_gprs_active.py: using CellId 26011 04:32:11.210196 tst cs_paging_gprs_active.py: using BVCI 26012 04:32:11.328774 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.340445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.351881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.363513 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.375001 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.386450 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.398010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.409432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:11.420810 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:11.535274 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:11.654532 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:32:11.871629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:12.193312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26643): Launched 04:32:12.473541 run iperf3-srv_10.42.42.10(pid=26644): Launched 04:32:12.593664 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:32:12.809911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:13.131896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26645): Launched 04:32:13.411670 run iperf3-srv_10.42.42.10(pid=26646): Launched 04:32:13.531841 tst cs_paging_gprs_active.py:38: start network... 04:32:13.748533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:14.245537 run create_hlr_db(pid=26647): Launched 04:32:14.376474 bus /gobi_6: Setting Powered False 04:32:15.440063 run create_hlr_db(pid=26647): Terminated: ok {rc=0} 04:32:15.881870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26649): Launched 04:32:16.236231 run osmo-hlr_10.42.42.2(pid=26650): Launched 04:32:16.485794 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:17.105845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26652): Launched 04:32:17.435590 run osmo-stp_10.42.42.5(pid=26653): Launched 04:32:17.559717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:18.114449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26655): Launched 04:32:18.237419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:18.509508 run patchelf(pid=26656): Launched 04:32:18.688207 run osmo-stp_10.42.42.5(pid=26653): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26653)] 04:32:18.823855 run osmo-stp_10.42.42.5(pid=26653): stdout: | (launched: 2022-12-10_04:32:17.377214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:18.962056 run osmo-stp_10.42.42.5(pid=26653): stderr: | 20221210043217567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043217568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043217568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043217568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043217569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043217569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043217569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:19.099745 run osmo-stp_10.42.42.5(pid=26653): stdout: | (launched: 2022-12-10_04:32:17.377214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:19.231276 run osmo-stp_10.42.42.5(pid=26653): stderr: | 20221210043217567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043217568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043217568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043217568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043217569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043217569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043217569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:19.387839 run patchelf(pid=26656): Terminating (SIGINT) 04:32:19.567780 run patchelf(pid=26656): Terminated: ok {rc=0} 04:32:19.697224 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26653): Process ended prematurely: osmo-stp_10.42.42.5(pid=26653) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26653)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:32:19.707587 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 04:32:19.736108 run osmo-hlr_10.42.42.2(pid=26650): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26650)] 04:32:19.785545 run osmo-hlr_10.42.42.2(pid=26650): stdout: | (launched: 2022-12-10_04:32:16.172607) 04:32:19.836605 run osmo-hlr_10.42.42.2(pid=26650): stderr: | 20221210043216416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043216416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043216416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043216416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043216416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043216416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043216440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043216451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043216451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043216451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:19.888136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26643): Terminating (SIGTERM) 04:32:19.929756 run iperf3-srv_10.42.42.10(pid=26644): Terminating (SIGTERM) 04:32:19.971206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26645): Terminating (SIGTERM) 04:32:20.012818 run iperf3-srv_10.42.42.10(pid=26646): Terminating (SIGTERM) 04:32:20.054240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26649): Terminating (SIGTERM) 04:32:20.095776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26652): Terminating (SIGTERM) 04:32:20.137369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26655): Terminating (SIGTERM) 04:32:20.178994 --- ParallelTerminationStrategy: PID 26643 died... 04:32:20.198883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26643): Terminated: ok {rc=0} 04:32:20.244879 --- ParallelTerminationStrategy: PID 26644 died... 04:32:20.264428 run iperf3-srv_10.42.42.10(pid=26644): Terminated {rc=256} 04:32:20.310010 --- ParallelTerminationStrategy: PID 26645 died... 04:32:20.329835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26645): Terminated: ok {rc=0} 04:32:20.375697 --- ParallelTerminationStrategy: PID 26646 died... 04:32:20.395080 run iperf3-srv_10.42.42.10(pid=26646): Terminated {rc=256} 04:32:20.440886 --- ParallelTerminationStrategy: PID 26649 died... 04:32:20.460766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26649): Terminated: ok {rc=0} 04:32:20.506742 --- ParallelTerminationStrategy: PID 26652 died... 04:32:20.526365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26652): Terminated: ok {rc=0} 04:32:20.572232 --- ParallelTerminationStrategy: PID 26655 died... 04:32:20.591822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26655): Terminated: ok {rc=0} 04:32:20.678100 bus /gobi_0: Setting Powered False 04:32:21.776740 bus /gobi_0: Setting Powered False 04:32:22.891277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:32:24.038354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.050761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:32:24.121210 tst iperf3.py: using LAC 26012 04:32:24.247367 tst iperf3.py: using RAC 2 04:32:24.375342 tst iperf3.py: using CellId 26012 04:32:24.500089 tst iperf3.py: using BVCI 26013 04:32:24.616326 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.628007 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.639639 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.651159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.662626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.674673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.686385 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.697802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:24.709400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:24.826706 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:32:25.045146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:25.367222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26657): Launched 04:32:25.646192 run iperf3-srv_10.42.42.10(pid=26658): Launched 04:32:25.766091 tst iperf3.py:8: start network... 04:32:25.983001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:26.480395 run create_hlr_db(pid=26659): Launched 04:32:26.610189 bus /gobi_6: Setting Powered False 04:32:27.674150 run create_hlr_db(pid=26659): Terminated: ok {rc=0} 04:32:28.120586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26661): Launched 04:32:28.441858 run osmo-hlr_10.42.42.2(pid=26662): Launched 04:32:28.564903 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:29.121121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26664): Launched 04:32:29.441540 run osmo-stp_10.42.42.5(pid=26665): Launched 04:32:29.563804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:30.115962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26667): Launched 04:32:30.238719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:30.510500 run patchelf(pid=26668): Launched 04:32:30.689106 run osmo-stp_10.42.42.5(pid=26665): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26665)] 04:32:30.824698 run osmo-stp_10.42.42.5(pid=26665): stdout: | (launched: 2022-12-10_04:32:29.382911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:30.982602 run osmo-stp_10.42.42.5(pid=26665): stderr: | 20221210043229577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043229577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043229577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043229578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043229579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043229579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043229579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:31.123201 run osmo-stp_10.42.42.5(pid=26665): stdout: | (launched: 2022-12-10_04:32:29.382911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:31.257786 run osmo-stp_10.42.42.5(pid=26665): stderr: | 20221210043229577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043229577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043229577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043229578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043229579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043229579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043229579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:31.416647 run patchelf(pid=26668): Terminating (SIGINT) 04:32:31.599576 run patchelf(pid=26668): Terminated: ok {rc=0} 04:32:31.731946 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26665): Process ended prematurely: osmo-stp_10.42.42.5(pid=26665) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26665)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 04:32:31.743230 tst iperf3.py:8: Test FAILED (7.7 sec) 04:32:31.773037 run osmo-hlr_10.42.42.2(pid=26662): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26662)] 04:32:31.823926 run osmo-hlr_10.42.42.2(pid=26662): stdout: | (launched: 2022-12-10_04:32:28.383330) 04:32:31.876503 run osmo-hlr_10.42.42.2(pid=26662): stderr: | 20221210043228584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043228584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043228584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043228584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043228584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043228584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043228596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043228606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043228606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043228606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:31.929649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26657): Terminating (SIGTERM) 04:32:31.973212 run iperf3-srv_10.42.42.10(pid=26658): Terminating (SIGTERM) 04:32:32.018393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26661): Terminating (SIGTERM) 04:32:32.061934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26664): Terminating (SIGTERM) 04:32:32.105988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26667): Terminating (SIGTERM) 04:32:32.149026 --- ParallelTerminationStrategy: PID 26657 died... 04:32:32.169038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26657): Terminated: ok {rc=0} 04:32:32.216161 --- ParallelTerminationStrategy: PID 26658 died... 04:32:32.236114 run iperf3-srv_10.42.42.10(pid=26658): Terminated {rc=256} 04:32:32.282381 --- ParallelTerminationStrategy: PID 26661 died... 04:32:32.302001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26661): Terminated: ok {rc=0} 04:32:32.348218 --- ParallelTerminationStrategy: PID 26664 died... 04:32:32.367834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26664): Terminated: ok {rc=0} 04:32:32.413704 --- ParallelTerminationStrategy: PID 26667 died... 04:32:32.433258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26667): Terminated: ok {rc=0} 04:32:32.520125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:32:33.669871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:33.682091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:32:33.754796 tst iperf3m4.py: using LAC 26013 04:32:33.882750 tst iperf3m4.py: using RAC 3 04:32:34.006467 tst iperf3m4.py: using CellId 26013 04:32:34.130715 tst iperf3m4.py: using BVCI 26014 04:32:34.246234 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.257866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.269298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.280551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.292395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.303877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.315328 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.327004 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:34.338697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:34.454822 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:34.575999 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:34.692230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:34.807238 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:32:35.010105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:35.312303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26669): Launched 04:32:35.574067 run iperf3-srv_10.42.42.10(pid=26670): Launched 04:32:35.687321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:32:35.890066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:36.214157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26672): Launched 04:32:36.492910 run iperf3-srv_10.42.42.10(pid=26673): Launched 04:32:36.613966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:32:36.830323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:37.151607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26674): Launched 04:32:37.430644 run iperf3-srv_10.42.42.10(pid=26675): Launched 04:32:37.551169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:32:37.767215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:38.088116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26676): Launched 04:32:38.366591 run iperf3-srv_10.42.42.10(pid=26677): Launched 04:32:38.486528 tst iperf3m4.py:8: start network... 04:32:38.703347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:39.199600 run create_hlr_db(pid=26678): Launched 04:32:39.329111 bus /gobi_6: Setting Powered False 04:32:40.392354 run create_hlr_db(pid=26678): Terminated: ok {rc=0} 04:32:40.838355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Launched 04:32:41.158000 run osmo-hlr_10.42.42.2(pid=26681): Launched 04:32:41.279002 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:41.833171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Launched 04:32:42.153712 run osmo-stp_10.42.42.5(pid=26684): Launched 04:32:42.275870 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:42.829713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26686): Launched 04:32:42.951926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:43.222905 run patchelf(pid=26687): Launched 04:32:43.401458 run osmo-stp_10.42.42.5(pid=26684): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] 04:32:43.538006 run osmo-stp_10.42.42.5(pid=26684): stdout: | (launched: 2022-12-10_04:32:42.095024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:43.675715 run osmo-stp_10.42.42.5(pid=26684): stderr: | 20221210043242284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043242285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043242285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043242285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043242286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043242286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043242286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:43.813786 run osmo-stp_10.42.42.5(pid=26684): stdout: | (launched: 2022-12-10_04:32:42.095024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:43.945345 run osmo-stp_10.42.42.5(pid=26684): stderr: | 20221210043242284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043242285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043242285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043242285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043242286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043242286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043242286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:44.101523 run patchelf(pid=26687): Terminating (SIGINT) 04:32:44.281199 run patchelf(pid=26687): Terminated: ok {rc=0} 04:32:44.411464 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26684): Process ended prematurely: osmo-stp_10.42.42.5(pid=26684) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:32:44.422069 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:32:44.450917 run osmo-hlr_10.42.42.2(pid=26681): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26681)] 04:32:44.501126 run osmo-hlr_10.42.42.2(pid=26681): stdout: | (launched: 2022-12-10_04:32:41.099597) 04:32:44.552755 run osmo-hlr_10.42.42.2(pid=26681): stderr: | 20221210043241296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043241296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043241296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043241296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043241297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043241297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043241310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043241318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043241318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043241318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:44.604759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26669): Terminating (SIGTERM) 04:32:44.646252 run iperf3-srv_10.42.42.10(pid=26670): Terminating (SIGTERM) 04:32:44.688332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26672): Terminating (SIGTERM) 04:32:44.730042 run iperf3-srv_10.42.42.10(pid=26673): Terminating (SIGTERM) 04:32:44.771391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26674): Terminating (SIGTERM) 04:32:44.812931 run iperf3-srv_10.42.42.10(pid=26675): Terminating (SIGTERM) 04:32:44.854138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26676): Terminating (SIGTERM) 04:32:44.895365 run iperf3-srv_10.42.42.10(pid=26677): Terminating (SIGTERM) 04:32:44.936699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Terminating (SIGTERM) 04:32:44.978382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Terminating (SIGTERM) 04:32:45.019846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26686): Terminating (SIGTERM) 04:32:45.061417 --- ParallelTerminationStrategy: PID 26669 died... 04:32:45.081249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26669): Terminated: ok {rc=0} 04:32:45.127052 --- ParallelTerminationStrategy: PID 26670 died... 04:32:45.146366 run iperf3-srv_10.42.42.10(pid=26670): Terminated {rc=256} 04:32:45.191768 --- ParallelTerminationStrategy: PID 26672 died... 04:32:45.211126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26672): Terminated: ok {rc=0} 04:32:45.256696 --- ParallelTerminationStrategy: PID 26673 died... 04:32:45.275915 run iperf3-srv_10.42.42.10(pid=26673): Terminated {rc=256} 04:32:45.321515 --- ParallelTerminationStrategy: PID 26674 died... 04:32:45.340706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26674): Terminated: ok {rc=0} 04:32:45.386507 --- ParallelTerminationStrategy: PID 26675 died... 04:32:45.405728 run iperf3-srv_10.42.42.10(pid=26675): Terminated {rc=256} 04:32:45.451129 --- ParallelTerminationStrategy: PID 26676 died... 04:32:45.470400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26676): Terminated: ok {rc=0} 04:32:45.515984 --- ParallelTerminationStrategy: PID 26677 died... 04:32:45.535141 run iperf3-srv_10.42.42.10(pid=26677): Terminated {rc=256} 04:32:45.580548 --- ParallelTerminationStrategy: PID 26680 died... 04:32:45.599905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Terminated: ok {rc=0} 04:32:45.645274 --- ParallelTerminationStrategy: PID 26683 died... 04:32:45.664354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Terminated: ok {rc=0} 04:32:45.709996 --- ParallelTerminationStrategy: PID 26686 died... 04:32:45.729345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26686): Terminated: ok {rc=0} 04:32:45.816157 bus /gobi_4: Setting Powered False 04:32:46.923690 bus /gobi_4: Setting Powered False 04:32:48.053781 bus /gobi_1: Setting Powered False 04:32:49.151270 bus /gobi_1: Setting Powered False 04:32:50.263261 bus /gobi_0: Setting Powered False 04:32:51.361540 bus /gobi_0: Setting Powered False 04:32:52.478197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:32:53.582730 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:53.594888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:32:53.663433 tst ping.py: using LAC 26014 04:32:53.786139 tst ping.py: using RAC 4 04:32:53.910710 tst ping.py: using CellId 26014 04:32:54.035201 tst ping.py: using BVCI 26015 04:32:54.149254 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:54.160780 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:54.172138 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:54.183518 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:54.194784 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:54.206095 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:54.217512 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:32:54.228769 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:32:54.344518 tst ping.py:19: start network... 04:32:54.557531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:55.045296 run create_hlr_db(pid=26688): Launched 04:32:55.172863 bus /gobi_6: Setting Powered False 04:32:56.235660 run create_hlr_db(pid=26688): Terminated: ok {rc=0} 04:32:56.658306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26690): Launched 04:32:56.955132 run osmo-hlr_10.42.42.2(pid=26691): Launched 04:32:57.067262 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:57.596701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26693): Launched 04:32:57.892132 run osmo-stp_10.42.42.5(pid=26694): Launched 04:32:58.005173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:58.516827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26696): Launched 04:32:58.629854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:58.880666 run patchelf(pid=26697): Launched 04:32:59.045656 run osmo-stp_10.42.42.5(pid=26694): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26694)] 04:32:59.171596 run osmo-stp_10.42.42.5(pid=26694): stdout: | (launched: 2022-12-10_04:32:57.837669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:59.298299 run osmo-stp_10.42.42.5(pid=26694): stderr: | 20221210043258025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043258025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043258025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043258026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043258026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043258026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043258027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:59.425687 run osmo-stp_10.42.42.5(pid=26694): stdout: | (launched: 2022-12-10_04:32:57.837669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:59.547288 run osmo-stp_10.42.42.5(pid=26694): stderr: | 20221210043258025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043258025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043258025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043258026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043258026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043258026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043258027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:59.690749 run patchelf(pid=26697): Terminating (SIGINT) 04:32:59.857156 run patchelf(pid=26697): Terminated: ok {rc=0} 04:32:59.977127 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26694): Process ended prematurely: osmo-stp_10.42.42.5(pid=26694) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26694)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 04:32:59.986257 tst ping.py:22: Test FAILED (6.4 sec) 04:33:00.013369 run osmo-hlr_10.42.42.2(pid=26691): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26691)] 04:33:00.061284 run osmo-hlr_10.42.42.2(pid=26691): stdout: | (launched: 2022-12-10_04:32:56.900212) 04:33:00.110797 run osmo-hlr_10.42.42.2(pid=26691): stderr: | 20221210043257076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043257076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043257076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043257076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043257076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043257076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043257087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043257096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043257097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043257097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:00.160729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26690): Terminating (SIGTERM) 04:33:00.200582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26693): Terminating (SIGTERM) 04:33:00.241258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26696): Terminating (SIGTERM) 04:33:00.281414 --- ParallelTerminationStrategy: PID 26690 died... 04:33:00.300351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26690): Terminated: ok {rc=0} 04:33:00.345039 --- ParallelTerminationStrategy: PID 26693 died... 04:33:00.363700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26693): Terminated: ok {rc=0} 04:33:00.407904 --- ParallelTerminationStrategy: PID 26696 died... 04:33:00.426444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26696): Terminated: ok {rc=0} 04:33:00.510889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:33:01.594870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:01.609982 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:01.689569 tst ping_idle_ping.py: using LAC 26015 04:33:01.808371 tst ping_idle_ping.py: using RAC 5 04:33:01.928284 tst ping_idle_ping.py: using CellId 26015 04:33:02.056271 tst ping_idle_ping.py: using BVCI 26016 04:33:02.167111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:02.179113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:02.190914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:02.203169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:02.215679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:02.227515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:02.239879 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:02.251986 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:02.367129 tst ping_idle_ping.py:24: start network... 04:33:02.565843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:03.027387 run create_hlr_db(pid=26699): Launched 04:33:03.140687 bus /gobi_6: Setting Powered False 04:33:04.200644 run create_hlr_db(pid=26699): Terminated: ok {rc=0} 04:33:04.634097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26701): Launched 04:33:04.950204 run osmo-hlr_10.42.42.2(pid=26702): Launched 04:33:05.070497 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:05.618335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26704): Launched 04:33:05.933060 run osmo-stp_10.42.42.5(pid=26705): Launched 04:33:06.053703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:06.608491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26707): Launched 04:33:06.728649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:06.995846 run patchelf(pid=26708): Launched 04:33:07.171742 run osmo-stp_10.42.42.5(pid=26705): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26705)] 04:33:07.305657 run osmo-stp_10.42.42.5(pid=26705): stdout: | (launched: 2022-12-10_04:33:05.875342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:07.441404 run osmo-stp_10.42.42.5(pid=26705): stderr: | 20221210043306069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043306069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043306069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043306070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043306070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043306070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043306070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:07.576640 run osmo-stp_10.42.42.5(pid=26705): stdout: | (launched: 2022-12-10_04:33:05.875342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:07.706477 run osmo-stp_10.42.42.5(pid=26705): stderr: | 20221210043306069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043306069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043306069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043306070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043306070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043306070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043306070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:07.859507 run patchelf(pid=26708): Terminating (SIGINT) 04:33:08.036374 run patchelf(pid=26708): Terminated: ok {rc=0} 04:33:08.164065 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26705): Process ended prematurely: osmo-stp_10.42.42.5(pid=26705) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26705)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:33:08.173929 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:33:08.202078 run osmo-hlr_10.42.42.2(pid=26702): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26702)] 04:33:08.251599 run osmo-hlr_10.42.42.2(pid=26702): stdout: | (launched: 2022-12-10_04:33:04.892536) 04:33:08.302879 run osmo-hlr_10.42.42.2(pid=26702): stderr: | 20221210043305088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043305088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043305088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043305088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043305088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043305088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043305099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043305107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043305107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043305108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:08.355645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26701): Terminating (SIGTERM) 04:33:08.397250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26704): Terminating (SIGTERM) 04:33:08.438647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26707): Terminating (SIGTERM) 04:33:08.480355 --- ParallelTerminationStrategy: PID 26701 died... 04:33:08.500361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26701): Terminated: ok {rc=0} 04:33:08.546442 --- ParallelTerminationStrategy: PID 26704 died... 04:33:08.565928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26704): Terminated: ok {rc=0} 04:33:08.611529 --- ParallelTerminationStrategy: PID 26707 died... 04:33:08.631026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26707): Terminated: ok {rc=0} 04:33:08.717882 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:33:10.018704 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:33:10.025121 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:33:10.056595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:33:10.095899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:33:10.184425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:33:10.215006 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:33:10.253882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:33:10.846035 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:33:10.896464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:10.907895 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:33:10.974547 tst cs_paging_gprs_active.py: using LAC 26016 04:33:11.097417 tst cs_paging_gprs_active.py: using RAC 6 04:33:11.215746 tst cs_paging_gprs_active.py: using CellId 26016 04:33:11.335673 tst cs_paging_gprs_active.py: using BVCI 26017 04:33:11.446532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.457713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.468540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.479607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.490636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.501802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.513081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.524266 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:11.535401 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:11.654840 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:11.771114 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:33:11.976092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:12.279488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26712): Launched 04:33:12.542230 run iperf3-srv_10.42.42.10(pid=26713): Launched 04:33:12.655406 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:33:12.858368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:13.162501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Launched 04:33:13.425518 run iperf3-srv_10.42.42.10(pid=26715): Launched 04:33:13.539047 tst cs_paging_gprs_active.py:38: start network... 04:33:13.741875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:14.209570 run create_hlr_db(pid=26716): Launched 04:33:14.324769 bus /gobi_6: Setting Powered False 04:33:15.385563 run create_hlr_db(pid=26716): Terminated: ok {rc=0} 04:33:15.825812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26718): Launched 04:33:16.176423 run osmo-hlr_10.42.42.2(pid=26719): Launched 04:33:16.490482 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:17.112348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26721): Launched 04:33:17.447309 run osmo-stp_10.42.42.5(pid=26722): Launched 04:33:17.570406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:18.125362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26724): Launched 04:33:18.247815 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:18.526744 run patchelf(pid=26725): Launched 04:33:18.705703 run osmo-stp_10.42.42.5(pid=26722): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26722)] 04:33:18.841832 run osmo-stp_10.42.42.5(pid=26722): stdout: | (launched: 2022-12-10_04:33:17.388603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:18.980540 run osmo-stp_10.42.42.5(pid=26722): stderr: | 20221210043317582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043317583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043317583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043317583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043317584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043317584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043317584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:19.119211 run osmo-stp_10.42.42.5(pid=26722): stdout: | (launched: 2022-12-10_04:33:17.388603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:19.250983 run osmo-stp_10.42.42.5(pid=26722): stderr: | 20221210043317582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043317583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043317583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043317583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043317584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043317584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043317584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:19.408234 run patchelf(pid=26725): Terminating (SIGINT) 04:33:19.588672 run patchelf(pid=26725): Terminated: ok {rc=0} 04:33:19.718777 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26722): Process ended prematurely: osmo-stp_10.42.42.5(pid=26722) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26722)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:33:19.729237 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:33:19.758130 run osmo-hlr_10.42.42.2(pid=26719): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26719)] 04:33:19.808137 run osmo-hlr_10.42.42.2(pid=26719): stdout: | (launched: 2022-12-10_04:33:16.116164) 04:33:19.859551 run osmo-hlr_10.42.42.2(pid=26719): stderr: | 20221210043316434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043316434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043316434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043316435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043316435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043316435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043316456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043316464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043316464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043316464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:19.911296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26712): Terminating (SIGTERM) 04:33:19.953057 run iperf3-srv_10.42.42.10(pid=26713): Terminating (SIGTERM) 04:33:19.994773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Terminating (SIGTERM) 04:33:20.036669 run iperf3-srv_10.42.42.10(pid=26715): Terminating (SIGTERM) 04:33:20.078213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26718): Terminating (SIGTERM) 04:33:20.119931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26721): Terminating (SIGTERM) 04:33:20.161750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26724): Terminating (SIGTERM) 04:33:20.203666 --- ParallelTerminationStrategy: PID 26712 died... 04:33:20.223702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26712): Terminated: ok {rc=0} 04:33:20.270543 --- ParallelTerminationStrategy: PID 26713 died... 04:33:20.290222 run iperf3-srv_10.42.42.10(pid=26713): Terminated {rc=256} 04:33:20.336379 --- ParallelTerminationStrategy: PID 26714 died... 04:33:20.356317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Terminated: ok {rc=0} 04:33:20.402414 --- ParallelTerminationStrategy: PID 26715 died... 04:33:20.422022 run iperf3-srv_10.42.42.10(pid=26715): Terminated {rc=256} 04:33:20.467869 --- ParallelTerminationStrategy: PID 26718 died... 04:33:20.487647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26718): Terminated: ok {rc=0} 04:33:20.533758 --- ParallelTerminationStrategy: PID 26721 died... 04:33:20.553443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26721): Terminated: ok {rc=0} 04:33:20.599622 --- ParallelTerminationStrategy: PID 26724 died... 04:33:20.619171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26724): Terminated: ok {rc=0} 04:33:20.706343 bus /gobi_0: Setting Powered False 04:33:21.806058 bus /gobi_0: Setting Powered False 04:33:22.921084 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:33:24.069692 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.081806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:33:24.149987 tst iperf3.py: using LAC 26017 04:33:24.270628 tst iperf3.py: using RAC 7 04:33:24.390982 tst iperf3.py: using CellId 26017 04:33:24.509351 tst iperf3.py: using BVCI 26018 04:33:24.619416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.630753 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.641864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.653509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.665099 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.676656 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.688361 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.700136 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:24.711829 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:24.830223 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:33:25.047189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:25.369109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26726): Launched 04:33:25.647857 run iperf3-srv_10.42.42.10(pid=26727): Launched 04:33:25.767639 tst iperf3.py:8: start network... 04:33:25.984301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:26.481945 run create_hlr_db(pid=26728): Launched 04:33:26.611944 bus /gobi_6: Setting Powered False 04:33:27.676139 run create_hlr_db(pid=26728): Terminated: ok {rc=0} 04:33:28.106165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Launched 04:33:28.408759 run osmo-hlr_10.42.42.2(pid=26731): Launched 04:33:28.523975 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:29.046302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Launched 04:33:29.348468 run osmo-stp_10.42.42.5(pid=26734): Launched 04:33:29.463735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:29.985016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26736): Launched 04:33:30.101385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:30.356880 run patchelf(pid=26737): Launched 04:33:30.524371 run osmo-stp_10.42.42.5(pid=26734): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] 04:33:30.652712 run osmo-stp_10.42.42.5(pid=26734): stdout: | (launched: 2022-12-10_04:33:29.292450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:30.782207 run osmo-stp_10.42.42.5(pid=26734): stderr: | 20221210043329462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043329462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043329463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043329463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043329465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043329466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043329466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:30.937607 run osmo-stp_10.42.42.5(pid=26734): stdout: | (launched: 2022-12-10_04:33:29.292450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:31.076641 run osmo-stp_10.42.42.5(pid=26734): stderr: | 20221210043329462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043329462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043329463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043329463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043329465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043329466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043329466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:31.236158 run patchelf(pid=26737): Terminating (SIGINT) 04:33:31.422769 run patchelf(pid=26737): Terminated: ok {rc=0} 04:33:31.556378 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26734): Process ended prematurely: osmo-stp_10.42.42.5(pid=26734) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 04:33:31.567640 tst iperf3.py:8: Test FAILED (7.5 sec) 04:33:31.597767 run osmo-hlr_10.42.42.2(pid=26731): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26731)] 04:33:31.649447 run osmo-hlr_10.42.42.2(pid=26731): stdout: | (launched: 2022-12-10_04:33:28.353114) 04:33:31.703018 run osmo-hlr_10.42.42.2(pid=26731): stderr: | 20221210043328530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043328530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043328530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043328530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043328530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043328530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043328545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043328556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043328556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043328556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:31.757308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26726): Terminating (SIGTERM) 04:33:31.800648 run iperf3-srv_10.42.42.10(pid=26727): Terminating (SIGTERM) 04:33:31.845821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Terminating (SIGTERM) 04:33:31.890125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Terminating (SIGTERM) 04:33:31.935431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26736): Terminating (SIGTERM) 04:33:31.982890 --- ParallelTerminationStrategy: PID 26726 died... 04:33:32.003330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26726): Terminated: ok {rc=0} 04:33:32.053672 --- ParallelTerminationStrategy: PID 26727 died... 04:33:32.074138 run iperf3-srv_10.42.42.10(pid=26727): Terminated {rc=256} 04:33:32.122905 --- ParallelTerminationStrategy: PID 26730 died... 04:33:32.143445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Terminated: ok {rc=0} 04:33:32.192760 --- ParallelTerminationStrategy: PID 26733 died... 04:33:32.212600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Terminated: ok {rc=0} 04:33:32.258827 --- ParallelTerminationStrategy: PID 26736 died... 04:33:32.278614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26736): Terminated: ok {rc=0} 04:33:32.366535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:33:33.515450 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:33.527598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:33:33.597466 tst iperf3m4.py: using LAC 26018 04:33:33.722246 tst iperf3m4.py: using RAC 8 04:33:33.846766 tst iperf3m4.py: using CellId 26018 04:33:33.973056 tst iperf3m4.py: using BVCI 26019 04:33:34.088589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.100159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.111510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.122871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.134354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.145686 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.157129 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.168284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:34.179798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:34.294440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:34.416057 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:34.531015 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:34.648619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:33:34.867190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:35.189331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26738): Launched 04:33:35.469933 run iperf3-srv_10.42.42.10(pid=26739): Launched 04:33:35.590205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:33:35.807362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:36.130236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26740): Launched 04:33:36.410195 run iperf3-srv_10.42.42.10(pid=26741): Launched 04:33:36.530616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:33:36.747963 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:37.071641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26742): Launched 04:33:37.352490 run iperf3-srv_10.42.42.10(pid=26743): Launched 04:33:37.472857 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:33:37.690661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:38.013672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26744): Launched 04:33:38.293539 run iperf3-srv_10.42.42.10(pid=26745): Launched 04:33:38.414342 tst iperf3m4.py:8: start network... 04:33:38.630853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:39.131775 run create_hlr_db(pid=26746): Launched 04:33:39.262197 bus /gobi_6: Setting Powered False 04:33:40.326522 run create_hlr_db(pid=26746): Terminated: ok {rc=0} 04:33:40.774602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26748): Launched 04:33:41.096726 run osmo-hlr_10.42.42.2(pid=26749): Launched 04:33:41.219218 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:41.772363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26751): Launched 04:33:42.093576 run osmo-stp_10.42.42.5(pid=26752): Launched 04:33:42.215977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:42.770217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26754): Launched 04:33:42.893153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:43.164809 run patchelf(pid=26755): Launched 04:33:43.342722 run osmo-stp_10.42.42.5(pid=26752): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26752)] 04:33:43.479075 run osmo-stp_10.42.42.5(pid=26752): stdout: | (launched: 2022-12-10_04:33:42.034694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:43.616482 run osmo-stp_10.42.42.5(pid=26752): stderr: | 20221210043342227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043342227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043342227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043342228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043342228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043342228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043342228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:43.754242 run osmo-stp_10.42.42.5(pid=26752): stdout: | (launched: 2022-12-10_04:33:42.034694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:43.885555 run osmo-stp_10.42.42.5(pid=26752): stderr: | 20221210043342227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043342227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043342227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043342228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043342228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043342228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043342228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:44.041620 run patchelf(pid=26755): Terminating (SIGINT) 04:33:44.221454 run patchelf(pid=26755): Terminated: ok {rc=0} 04:33:44.351682 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26752): Process ended prematurely: osmo-stp_10.42.42.5(pid=26752) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26752)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:33:44.362253 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:33:44.391115 run osmo-hlr_10.42.42.2(pid=26749): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26749)] 04:33:44.440662 run osmo-hlr_10.42.42.2(pid=26749): stdout: | (launched: 2022-12-10_04:33:41.037826) 04:33:44.491969 run osmo-hlr_10.42.42.2(pid=26749): stderr: | 20221210043341237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043341237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043341237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043341237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043341237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043341237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043341252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043341261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043341261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043341261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:44.543711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26738): Terminating (SIGTERM) 04:33:44.585265 run iperf3-srv_10.42.42.10(pid=26739): Terminating (SIGTERM) 04:33:44.626568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26740): Terminating (SIGTERM) 04:33:44.668005 run iperf3-srv_10.42.42.10(pid=26741): Terminating (SIGTERM) 04:33:44.709323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26742): Terminating (SIGTERM) 04:33:44.750740 run iperf3-srv_10.42.42.10(pid=26743): Terminating (SIGTERM) 04:33:44.792052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26744): Terminating (SIGTERM) 04:33:44.833581 run iperf3-srv_10.42.42.10(pid=26745): Terminating (SIGTERM) 04:33:44.874747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26748): Terminating (SIGTERM) 04:33:44.916077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26751): Terminating (SIGTERM) 04:33:44.957506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26754): Terminating (SIGTERM) 04:33:44.999017 --- ParallelTerminationStrategy: PID 26738 died... 04:33:45.019297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26738): Terminated: ok {rc=0} 04:33:45.065483 --- ParallelTerminationStrategy: PID 26739 died... 04:33:45.084899 run iperf3-srv_10.42.42.10(pid=26739): Terminated {rc=256} 04:33:45.130819 --- ParallelTerminationStrategy: PID 26740 died... 04:33:45.150568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26740): Terminated: ok {rc=0} 04:33:45.196328 --- ParallelTerminationStrategy: PID 26741 died... 04:33:45.215849 run iperf3-srv_10.42.42.10(pid=26741): Terminated {rc=256} 04:33:45.261299 --- ParallelTerminationStrategy: PID 26742 died... 04:33:45.280404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26742): Terminated: ok {rc=0} 04:33:45.326216 --- ParallelTerminationStrategy: PID 26743 died... 04:33:45.345693 run iperf3-srv_10.42.42.10(pid=26743): Terminated {rc=256} 04:33:45.391536 --- ParallelTerminationStrategy: PID 26744 died... 04:33:45.411248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26744): Terminated: ok {rc=0} 04:33:45.456920 --- ParallelTerminationStrategy: PID 26745 died... 04:33:45.476318 run iperf3-srv_10.42.42.10(pid=26745): Terminated {rc=256} 04:33:45.522092 --- ParallelTerminationStrategy: PID 26748 died... 04:33:45.541517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26748): Terminated: ok {rc=0} 04:33:45.587175 --- ParallelTerminationStrategy: PID 26751 died... 04:33:45.606614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26751): Terminated: ok {rc=0} 04:33:45.652279 --- ParallelTerminationStrategy: PID 26754 died... 04:33:45.671795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26754): Terminated: ok {rc=0} 04:33:45.758042 bus /gobi_4: Setting Powered False 04:33:46.863195 bus /gobi_4: Setting Powered False 04:33:47.979887 bus /gobi_1: Setting Powered False 04:33:49.078414 bus /gobi_1: Setting Powered False 04:33:50.194138 bus /gobi_0: Setting Powered False 04:33:51.292859 bus /gobi_0: Setting Powered False 04:33:52.408507 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:33:53.511384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:53.523288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:33:53.590904 tst ping.py: using LAC 26019 04:33:53.706266 tst ping.py: using RAC 9 04:33:53.823834 tst ping.py: using CellId 26019 04:33:53.938923 tst ping.py: using BVCI 26020 04:33:54.047360 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:54.058514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:54.069530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:54.080577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:54.091776 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:54.102933 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:54.114128 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:33:54.125774 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:33:54.238944 tst ping.py:19: start network... 04:33:54.437326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:54.893902 run create_hlr_db(pid=26756): Launched 04:33:55.005314 bus /gobi_6: Setting Powered False 04:33:56.064578 run create_hlr_db(pid=26756): Terminated: ok {rc=0} 04:33:56.497048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26758): Launched 04:33:56.813053 run osmo-hlr_10.42.42.2(pid=26759): Launched 04:33:56.934432 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:57.487350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26761): Launched 04:33:57.803320 run osmo-stp_10.42.42.5(pid=26762): Launched 04:33:57.923658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:58.468412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26764): Launched 04:33:58.588475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:58.854897 run patchelf(pid=26765): Launched 04:33:59.029460 run osmo-stp_10.42.42.5(pid=26762): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26762)] 04:33:59.162847 run osmo-stp_10.42.42.5(pid=26762): stdout: | (launched: 2022-12-10_04:33:57.745241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:59.297622 run osmo-stp_10.42.42.5(pid=26762): stderr: | 20221210043357935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043357935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043357935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043357935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043357936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043357936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043357936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:59.432709 run osmo-stp_10.42.42.5(pid=26762): stdout: | (launched: 2022-12-10_04:33:57.745241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:59.561785 run osmo-stp_10.42.42.5(pid=26762): stderr: | 20221210043357935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043357935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043357935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043357935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043357936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043357936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043357936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:59.714475 run patchelf(pid=26765): Terminating (SIGINT) 04:33:59.890340 run patchelf(pid=26765): Terminated: ok {rc=0} 04:34:00.017082 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26762): Process ended prematurely: osmo-stp_10.42.42.5(pid=26762) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26762)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 04:34:00.026811 tst ping.py:22: Test FAILED (6.5 sec) 04:34:00.054913 run osmo-hlr_10.42.42.2(pid=26759): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26759)] 04:34:00.104529 run osmo-hlr_10.42.42.2(pid=26759): stdout: | (launched: 2022-12-10_04:33:56.755276) 04:34:00.155754 run osmo-hlr_10.42.42.2(pid=26759): stderr: | 20221210043356953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043356953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043356953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043356953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043356953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043356953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043356965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043356973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043356973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043356973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:00.207471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26758): Terminating (SIGTERM) 04:34:00.248910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26761): Terminating (SIGTERM) 04:34:00.290470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26764): Terminating (SIGTERM) 04:34:00.332920 --- ParallelTerminationStrategy: PID 26758 died... 04:34:00.352942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26758): Terminated: ok {rc=0} 04:34:00.400075 --- ParallelTerminationStrategy: PID 26761 died... 04:34:00.419675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26761): Terminated: ok {rc=0} 04:34:00.465566 --- ParallelTerminationStrategy: PID 26764 died... 04:34:00.485012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26764): Terminated: ok {rc=0} 04:34:00.572107 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:34:01.658290 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:01.671606 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:01.747345 tst ping_idle_ping.py: using LAC 26020 04:34:01.872192 tst ping_idle_ping.py: using RAC 10 04:34:02.029698 tst ping_idle_ping.py: using CellId 26020 04:34:02.147507 tst ping_idle_ping.py: using BVCI 26021 04:34:02.259468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:02.271251 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:02.282810 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:02.295766 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:02.307614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:02.318953 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:02.331819 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:02.342918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:02.462796 tst ping_idle_ping.py:24: start network... 04:34:02.677470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:03.169403 run create_hlr_db(pid=26766): Launched 04:34:03.297454 bus /gobi_6: Setting Powered False 04:34:04.361366 run create_hlr_db(pid=26766): Terminated: ok {rc=0} 04:34:04.786596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26768): Launched 04:34:05.083790 run osmo-hlr_10.42.42.2(pid=26769): Launched 04:34:05.197356 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:05.722913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26771): Launched 04:34:06.020360 run osmo-stp_10.42.42.5(pid=26772): Launched 04:34:06.133973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:06.646396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26774): Launched 04:34:06.760239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:07.011710 run patchelf(pid=26775): Launched 04:34:07.177394 run osmo-stp_10.42.42.5(pid=26772): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26772)] 04:34:07.303308 run osmo-stp_10.42.42.5(pid=26772): stdout: | (launched: 2022-12-10_04:34:05.965426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:07.431169 run osmo-stp_10.42.42.5(pid=26772): stderr: | 20221210043406135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043406135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043406135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043406135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043406136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043406136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043406136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:07.559308 run osmo-stp_10.42.42.5(pid=26772): stdout: | (launched: 2022-12-10_04:34:05.965426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:07.681168 run osmo-stp_10.42.42.5(pid=26772): stderr: | 20221210043406135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043406135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043406135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043406135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043406136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043406136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043406136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:07.825749 run patchelf(pid=26775): Terminating (SIGINT) 04:34:07.993234 run patchelf(pid=26775): Terminated: ok {rc=0} 04:34:08.114039 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26772): Process ended prematurely: osmo-stp_10.42.42.5(pid=26772) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26772)] [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:34:08.123076 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:34:08.150432 run osmo-hlr_10.42.42.2(pid=26769): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26769)] 04:34:08.197953 run osmo-hlr_10.42.42.2(pid=26769): stdout: | (launched: 2022-12-10_04:34:05.028811) 04:34:08.247231 run osmo-hlr_10.42.42.2(pid=26769): stderr: | 20221210043405203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043405203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043405203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043405203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043405204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043405204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043405216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043405227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043405227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043405227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:08.296748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26768): Terminating (SIGTERM) 04:34:08.336411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26771): Terminating (SIGTERM) 04:34:08.376134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26774): Terminating (SIGTERM) 04:34:08.416126 --- ParallelTerminationStrategy: PID 26768 died... 04:34:08.435177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26768): Terminated: ok {rc=0} 04:34:08.479606 --- ParallelTerminationStrategy: PID 26771 died... 04:34:08.498326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26771): Terminated: ok {rc=0} 04:34:08.542619 --- ParallelTerminationStrategy: PID 26774 died... 04:34:08.561342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26774): Terminated: ok {rc=0} 04:34:08.645128 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:34:09.950776 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:09.957836 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:34:09.987602 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:34:10.023226 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:34:10.078854 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:34:10.108792 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:34:10.144075 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:34:10.706786 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:34:10.712024 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:10.723904 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:34:10.791162 tst switch_tch_pdch.py: using LAC 26021 04:34:10.914181 tst switch_tch_pdch.py: using RAC 11 04:34:11.037983 tst switch_tch_pdch.py: using CellId 26021 04:34:11.171365 tst switch_tch_pdch.py: using BVCI 26022 04:34:11.287778 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:11.299666 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:11.311454 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:11.323116 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:11.334847 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:11.346892 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:11.358930 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:34:11.371077 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:34:11.490704 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:34:11.611361 tst switch_tch_pdch.py:51: start network... 04:34:11.824585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:12.314022 run create_hlr_db(pid=26781): Launched 04:34:12.442450 bus /gobi_6: Setting Powered False 04:34:13.506006 run create_hlr_db(pid=26781): Terminated: ok {rc=0} 04:34:13.946166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26783): Launched 04:34:14.261466 run osmo-hlr_10.42.42.2(pid=26784): Launched 04:34:14.382824 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:14.930348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26786): Launched 04:34:15.246011 run osmo-stp_10.42.42.5(pid=26787): Launched 04:34:15.367176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:15.930791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26789): Launched 04:34:16.061205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:16.338560 run patchelf(pid=26790): Launched 04:34:16.548290 run osmo-stp_10.42.42.5(pid=26787): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26787)] 04:34:16.688029 run osmo-stp_10.42.42.5(pid=26787): stdout: | (launched: 2022-12-10_04:34:15.188170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:16.827815 run osmo-stp_10.42.42.5(pid=26787): stderr: | 20221210043415381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043415381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043415381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043415382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043415382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043415382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043415382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:16.968082 run osmo-stp_10.42.42.5(pid=26787): stdout: | (launched: 2022-12-10_04:34:15.188170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:17.102152 run osmo-stp_10.42.42.5(pid=26787): stderr: | 20221210043415381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043415381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043415381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043415382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043415382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043415382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043415382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:17.257740 run patchelf(pid=26790): Terminating (SIGINT) 04:34:17.436250 run patchelf(pid=26790): Terminated: ok {rc=0} 04:34:17.564169 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26787): Process ended prematurely: osmo-stp_10.42.42.5(pid=26787) [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26787)] [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:34:17.574023 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 04:34:17.602154 run osmo-hlr_10.42.42.2(pid=26784): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26784)] 04:34:17.651936 run osmo-hlr_10.42.42.2(pid=26784): stdout: | (launched: 2022-12-10_04:34:14.203643) 04:34:17.703565 run osmo-hlr_10.42.42.2(pid=26784): stderr: | 20221210043414400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043414400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043414400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043414400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043414400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043414401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043414413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043414421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043414421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043414421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:17.755445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26783): Terminating (SIGTERM) 04:34:17.797195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26786): Terminating (SIGTERM) 04:34:17.838685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26789): Terminating (SIGTERM) 04:34:17.880391 --- ParallelTerminationStrategy: PID 26783 died... 04:34:17.900334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26783): Terminated: ok {rc=0} 04:34:17.946467 --- ParallelTerminationStrategy: PID 26786 died... 04:34:17.966040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26786): Terminated: ok {rc=0} 04:34:18.011769 --- ParallelTerminationStrategy: PID 26789 died... 04:34:18.031275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26789): Terminated: ok {rc=0} 04:34:18.118168 bus /gobi_0: Setting Powered False 04:34:19.215524 bus /gobi_0: Setting Powered False 04:34:20.331233 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:34:21.582940 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:21.588659 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:34:21.618548 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:34:21.652914 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:34:21.707134 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:34:21.737373 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:34:21.772688 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:34:22.329606 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:34:22.334963 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.346879 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:34:22.414758 tst switch_tch_pdch.py: using LAC 26022 04:34:22.538912 tst switch_tch_pdch.py: using RAC 12 04:34:22.664384 tst switch_tch_pdch.py: using CellId 26022 04:34:22.789384 tst switch_tch_pdch.py: using BVCI 26023 04:34:22.904011 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.915672 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.927123 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.938550 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.949923 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.961382 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.972765 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:34:22.984115 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:34:23.100941 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:34:23.216305 tst switch_tch_pdch.py:51: start network... 04:34:23.416402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:23.850623 run create_hlr_db(pid=26794): Launched 04:34:23.963517 bus /gobi_6: Setting Powered False 04:34:25.022696 run create_hlr_db(pid=26794): Terminated: ok {rc=0} 04:34:25.429689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26796): Launched 04:34:25.745522 run osmo-hlr_10.42.42.2(pid=26797): Launched 04:34:25.866401 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:26.386335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26799): Launched 04:34:26.700902 run osmo-stp_10.42.42.5(pid=26800): Launched 04:34:26.821806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:27.339249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26802): Launched 04:34:27.459976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:27.726439 run patchelf(pid=26803): Launched 04:34:27.901486 run osmo-stp_10.42.42.5(pid=26800): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26800)] 04:34:28.035465 run osmo-stp_10.42.42.5(pid=26800): stdout: | (launched: 2022-12-10_04:34:26.643331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:28.170661 run osmo-stp_10.42.42.5(pid=26800): stderr: | 20221210043426834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043426834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043426834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043426834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043426837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043426837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043426837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:28.305532 run osmo-stp_10.42.42.5(pid=26800): stdout: | (launched: 2022-12-10_04:34:26.643331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:28.434928 run osmo-stp_10.42.42.5(pid=26800): stderr: | 20221210043426834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043426834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043426834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043426834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043426837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043426837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043426837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:28.588284 run patchelf(pid=26803): Terminating (SIGINT) 04:34:28.765099 run patchelf(pid=26803): Terminated: ok {rc=0} 04:34:28.892537 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26800): Process ended prematurely: osmo-stp_10.42.42.5(pid=26800) [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26800)] [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:34:28.902251 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 04:34:28.930518 run osmo-hlr_10.42.42.2(pid=26797): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26797)] 04:34:28.980105 run osmo-hlr_10.42.42.2(pid=26797): stdout: | (launched: 2022-12-10_04:34:25.687875) 04:34:29.031595 run osmo-hlr_10.42.42.2(pid=26797): stderr: | 20221210043425884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043425884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043425884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043425884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043425884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043425885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043425897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043425905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043425905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043425905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:29.083419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26796): Terminating (SIGTERM) 04:34:29.125134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26799): Terminating (SIGTERM) 04:34:29.166909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26802): Terminating (SIGTERM) 04:34:29.209048 --- ParallelTerminationStrategy: PID 26796 died... 04:34:29.229077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26796): Terminated: ok {rc=0} 04:34:29.275021 --- ParallelTerminationStrategy: PID 26799 died... 04:34:29.294630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26799): Terminated: ok {rc=0} 04:34:29.340603 --- ParallelTerminationStrategy: PID 26802 died... 04:34:29.360286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26802): Terminated: ok {rc=0} 04:34:29.448433 bus /gobi_0: Setting Powered False 04:34:30.546702 bus /gobi_0: Setting Powered False 04:34:31.662241 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_sms:nanobts --------------------------------------------------------------------- 04:34:32.908781 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:32.912871 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 04:34:32.937123 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 04:34:32.944579 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 04:34:33.000185 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 04:34:33.023902 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 04:34:33.030773 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 04:34:33.564276 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 04:34:33.569202 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 04:34:33.579855 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 04:34:33.617352 tst mo_mt_sms.py: using LAC 26023 04:34:33.733876 tst mo_mt_sms.py: using RAC 13 04:34:33.850295 tst mo_mt_sms.py: using CellId 26023 04:34:33.966586 tst mo_mt_sms.py: using BVCI 26024 04:34:34.073141 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 04:34:34.188467 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 04:34:34.303101 tst mo_mt_sms.py:9: start nitb and bts... 04:34:34.502649 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:34:35.107893 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26807): Launched 04:34:35.404118 run osmo-nitb_10.42.42.2(pid=26808): Launched 04:34:35.568627 run osmo-nitb_10.42.42.2(pid=26808): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26808)] 04:34:35.702167 run osmo-nitb_10.42.42.2(pid=26808): stdout: | (launched: 2022-12-10_04:34:35.349505) 04:34:35.837246 run osmo-nitb_10.42.42.2(pid=26808): stderr: | (launched: 2022-12-10_04:34:35.393431) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:34:35.971742 run osmo-nitb_10.42.42.2(pid=26808): stdout: | (launched: 2022-12-10_04:34:35.349505) 04:34:36.100679 run osmo-nitb_10.42.42.2(pid=26808): stderr: | (launched: 2022-12-10_04:34:35.393431) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26808) [trial-2369↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26808)] 04:34:36.515353 tst osmo-nitb_10.42.42.2(pid=26808): stdout: | (launched: 2022-12-10_04:34:35.349505) 04:34:36.636076 tst osmo-nitb_10.42.42.2(pid=26808): stderr: | (launched: 2022-12-10_04:34:35.393431) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:34:36.777299 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26808) [trial-2369↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26808)] [trial-2369↪nitb_sms:nanobts↪mo_mt_sms.py:11] 04:34:36.785886 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 04:34:36.792663 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26807): Terminating (SIGTERM) 04:34:37.002220 --- ParallelTerminationStrategy: PID 26807 died... 04:34:37.023391 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26807): Terminated: ok {rc=0} 04:34:37.108613 bus /sierra_3: Setting Powered False 04:34:38.207528 bus /sierra_3: Setting Powered False 04:34:39.321637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:nanobts+band-1900 --------------------------------------------------------------------- 04:34:40.511211 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:40.516386 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:34:40.540766 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:34:40.568567 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 04:34:40.620214 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:34:40.644661 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:34:40.672406 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 04:34:41.222110 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 04:34:41.227189 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:41.238409 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:34:41.276380 tst mo_mt_sms.py: using LAC 26024 04:34:41.401225 tst mo_mt_sms.py: using RAC 14 04:34:41.522921 tst mo_mt_sms.py: using CellId 26024 04:34:41.647540 tst mo_mt_sms.py: using BVCI 26025 04:34:41.763155 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:41.774330 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:41.785366 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:41.796363 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:41.807401 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:41.818368 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 04:34:41.931627 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 04:34:42.043404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:42.503639 run create_hlr_db(pid=26812): Launched 04:34:42.617622 bus /sierra_2: Setting Powered False 04:34:43.677138 run create_hlr_db(pid=26812): Terminated: ok {rc=0} 04:34:44.109940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26814): Launched 04:34:44.426036 run osmo-hlr_10.42.42.2(pid=26815): Launched 04:34:44.545646 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:45.088731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26817): Launched 04:34:45.403163 run osmo-stp_10.42.42.5(pid=26818): Launched 04:34:45.523296 run osmo-msc_10.42.42.6: Starting osmo-msc 04:34:46.114229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26820): Launched 04:34:46.447868 run osmo-msc_10.42.42.6(pid=26821): Launched 04:34:46.817292 run osmo-stp_10.42.42.5(pid=26818): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26818)] 04:34:47.096146 run osmo-stp_10.42.42.5(pid=26818): stdout: | (launched: 2022-12-10_04:34:45.345208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:47.242560 run osmo-stp_10.42.42.5(pid=26818): stderr: | 20221210043445535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043445535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043445535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043445536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043445536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043445536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043445536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:47.374963 run osmo-stp_10.42.42.5(pid=26818): stdout: | (launched: 2022-12-10_04:34:45.345208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:47.501442 run osmo-stp_10.42.42.5(pid=26818): stderr: | 20221210043445535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043445535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043445535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043445536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043445536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043445536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043445536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:47.652576 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26818): Process ended prematurely: osmo-stp_10.42.42.5(pid=26818) [trial-2369↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26818)] [trial-2369↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 04:34:47.661692 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 04:34:47.689588 run osmo-hlr_10.42.42.2(pid=26815): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26815)] 04:34:47.739344 run osmo-hlr_10.42.42.2(pid=26815): stdout: | (launched: 2022-12-10_04:34:44.368040) 04:34:47.790898 run osmo-hlr_10.42.42.2(pid=26815): stderr: | 20221210043444567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043444567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043444567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043444567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043444567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043444567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043444580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043444588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043444588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043444588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:47.862806 run osmo-msc_10.42.42.6(pid=26821): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26821)] 04:34:47.912434 run osmo-msc_10.42.42.6(pid=26821): stdout: | (launched: 2022-12-10_04:34:46.386898) 04:34:47.963739 run osmo-msc_10.42.42.6(pid=26821): stderr: | 20221210043446825 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043446825 DLGLOBAL DEBUG validating counter group 0x7efcba792c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043446825 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043446825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043446825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043446825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043446827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043446827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043446828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043446828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:34:48.015480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26814): Terminating (SIGTERM) 04:34:48.056787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26817): Terminating (SIGTERM) 04:34:48.098073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26820): Terminating (SIGTERM) 04:34:48.139523 --- ParallelTerminationStrategy: PID 26814 died... 04:34:48.159448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26814): Terminated: ok {rc=0} 04:34:48.205324 --- ParallelTerminationStrategy: PID 26817 died... 04:34:48.224558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26817): Terminated: ok {rc=0} 04:34:48.270346 --- ParallelTerminationStrategy: PID 26820 died... 04:34:48.289706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26820): Terminated: ok {rc=0} 04:34:48.376716 bus /sierra_3: Setting Powered False 04:34:49.474771 bus /sierra_3: Setting Powered False 04:34:50.589326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 04:34:51.814593 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:51.819730 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:34:51.843930 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 04:34:51.851199 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 04:34:51.886594 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:34:51.910398 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 04:34:51.917604 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 04:34:52.436166 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 04:34:52.441508 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 04:34:52.452314 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:34:52.490274 tst assert_extension.py: using LAC 26025 04:34:52.609072 tst assert_extension.py: using RAC 15 04:34:52.732567 tst assert_extension.py: using CellId 26025 04:34:52.856333 tst assert_extension.py: using BVCI 26026 04:34:52.970400 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 04:34:53.086387 tst assert_extension.py:10: start nitb and bts... 04:34:53.299841 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:34:53.944693 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26826): Launched 04:34:54.259544 run osmo-nitb_10.42.42.2(pid=26827): Launched 04:34:54.434473 run osmo-nitb_10.42.42.2(pid=26827): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26827)] 04:34:54.575372 run osmo-nitb_10.42.42.2(pid=26827): stdout: | (launched: 2022-12-10_04:34:54.202139) 04:34:54.717755 run osmo-nitb_10.42.42.2(pid=26827): stderr: | (launched: 2022-12-10_04:34:54.249037) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:34:54.860341 run osmo-nitb_10.42.42.2(pid=26827): stdout: | (launched: 2022-12-10_04:34:54.202139) 04:34:54.997151 run osmo-nitb_10.42.42.2(pid=26827): stderr: | (launched: 2022-12-10_04:34:54.249037) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26827): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26827) [trial-2369↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26827)] 04:34:55.378056 tst osmo-nitb_10.42.42.2(pid=26827): stdout: | (launched: 2022-12-10_04:34:54.202139) 04:34:55.506701 tst osmo-nitb_10.42.42.2(pid=26827): stderr: | (launched: 2022-12-10_04:34:54.249037) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:34:55.656779 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26827): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26827) [trial-2369↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26827)] [trial-2369↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 04:34:55.665950 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:34:55.672889 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26826): Terminating (SIGTERM) 04:34:55.883146 --- ParallelTerminationStrategy: PID 26826 died... 04:34:55.904461 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26826): Terminated: ok {rc=0} 04:34:55.991586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:nanobts+band-1900 --------------------------------------------------------------------- 04:34:57.159634 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:57.165026 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:34:57.189861 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:34:57.217658 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 04:34:57.254982 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:34:57.278245 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:34:57.304875 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 04:34:57.833175 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 04:34:57.838116 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:57.848681 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:34:57.889789 tst assert_extension.py: using LAC 26026 04:34:58.006714 tst assert_extension.py: using RAC 16 04:34:58.130772 tst assert_extension.py: using CellId 26026 04:34:58.247080 tst assert_extension.py: using BVCI 26027 04:34:58.354239 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:58.364804 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:58.375386 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:58.386261 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:58.397065 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:34:58.407803 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 04:34:58.522747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:59.011326 run create_hlr_db(pid=26831): Launched 04:34:59.139818 bus /sierra_2: Setting Powered False 04:35:00.202423 run create_hlr_db(pid=26831): Terminated: ok {rc=0} 04:35:00.642052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26833): Launched 04:35:00.969023 run osmo-hlr_10.42.42.2(pid=26834): Launched 04:35:01.143505 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:01.862976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26839): Launched 04:35:02.194462 run osmo-stp_10.42.42.5(pid=26840): Launched 04:35:02.355120 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:02.931801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26842): Launched 04:35:03.247549 run osmo-msc_10.42.42.6(pid=26843): Launched 04:35:03.424236 run osmo-stp_10.42.42.5(pid=26840): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26840)] 04:35:03.558008 run osmo-stp_10.42.42.5(pid=26840): stdout: | (launched: 2022-12-10_04:35:02.130918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:03.691645 run osmo-stp_10.42.42.5(pid=26840): stderr: | 20221210043502424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043502424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043502424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043502424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043502425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043502425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043502425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:03.825505 run osmo-stp_10.42.42.5(pid=26840): stdout: | (launched: 2022-12-10_04:35:02.130918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:03.951921 run osmo-stp_10.42.42.5(pid=26840): stderr: | 20221210043502424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043502424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043502424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043502424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043502425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043502425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043502425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:04.102718 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26840): Process ended prematurely: osmo-stp_10.42.42.5(pid=26840) [trial-2369↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26840)] [trial-2369↪ussd:nanobts+band-1900↪assert_extension.py:17] 04:35:04.111914 tst assert_extension.py:17: Test FAILED (6.3 sec) 04:35:04.139457 run osmo-hlr_10.42.42.2(pid=26834): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26834)] 04:35:04.189256 run osmo-hlr_10.42.42.2(pid=26834): stdout: | (launched: 2022-12-10_04:35:00.910221) 04:35:04.240790 run osmo-hlr_10.42.42.2(pid=26834): stderr: | 20221210043501242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043501242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043501242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043501242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043501242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043501242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043501258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043501270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043501271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043501271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:04.312588 run osmo-msc_10.42.42.6(pid=26843): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26843)] 04:35:04.362198 run osmo-msc_10.42.42.6(pid=26843): stdout: | (launched: 2022-12-10_04:35:03.189824) 04:35:04.413750 run osmo-msc_10.42.42.6(pid=26843): stderr: | 20221210043503508 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043503508 DLGLOBAL DEBUG validating counter group 0x7f2473697c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043503509 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043503509 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043503509 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043503509 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043503512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043503513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043503513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043503513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:04.465437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26833): Terminating (SIGTERM) 04:35:04.506458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26839): Terminating (SIGTERM) 04:35:04.547556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26842): Terminating (SIGTERM) 04:35:04.589082 --- ParallelTerminationStrategy: PID 26833 died... 04:35:04.608881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26833): Terminated: ok {rc=0} 04:35:04.654799 --- ParallelTerminationStrategy: PID 26839 died... 04:35:04.674294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26839): Terminated: ok {rc=0} 04:35:04.719850 --- ParallelTerminationStrategy: PID 26842 died... 04:35:04.739103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26842): Terminated: ok {rc=0} 04:35:04.826096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:35:06.029294 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:06.037707 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:35:06.062450 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:35:06.090238 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:35:06.143762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:35:06.169375 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:35:06.196710 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:35:06.745610 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:35:06.798442 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:06.810476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:35:06.871423 tst mo_mt_call.py: using LAC 26027 04:35:06.997497 tst mo_mt_call.py: using RAC 17 04:35:07.125090 tst mo_mt_call.py: using CellId 26027 04:35:07.250508 tst mo_mt_call.py: using BVCI 26028 04:35:07.366854 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:07.378663 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:07.390510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:07.402140 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:07.413817 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:07.425379 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:35:07.539091 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:35:07.654415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:08.121593 run create_hlr_db(pid=26848): Launched 04:35:08.237152 bus /sierra_2: Setting Powered False 04:35:09.297649 run create_hlr_db(pid=26848): Terminated: ok {rc=0} 04:35:09.737724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26850): Launched 04:35:10.060097 run osmo-hlr_10.42.42.2(pid=26851): Launched 04:35:10.182236 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:10.734246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26853): Launched 04:35:11.054033 run osmo-stp_10.42.42.5(pid=26854): Launched 04:35:11.176026 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:11.757253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26856): Launched 04:35:12.061683 run osmo-msc_10.42.42.6(pid=26857): Launched 04:35:12.231302 run osmo-stp_10.42.42.5(pid=26854): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26854)] 04:35:12.360513 run osmo-stp_10.42.42.5(pid=26854): stdout: | (launched: 2022-12-10_04:35:10.995248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:12.488830 run osmo-stp_10.42.42.5(pid=26854): stderr: | 20221210043511186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043511186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043511187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043511187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043511187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043511188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043511188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:12.614982 run osmo-stp_10.42.42.5(pid=26854): stdout: | (launched: 2022-12-10_04:35:10.995248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:12.735200 run osmo-stp_10.42.42.5(pid=26854): stderr: | 20221210043511186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043511186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043511187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043511187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043511187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043511188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043511188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:12.879022 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26854): Process ended prematurely: osmo-stp_10.42.42.5(pid=26854) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26854)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:35:12.888130 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:35:12.915448 run osmo-hlr_10.42.42.2(pid=26851): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26851)] 04:35:12.963462 run osmo-hlr_10.42.42.2(pid=26851): stdout: | (launched: 2022-12-10_04:35:10.001684) 04:35:13.013068 run osmo-hlr_10.42.42.2(pid=26851): stderr: | 20221210043510199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043510199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043510199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043510199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043510199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043510199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043510210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043510218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043510219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043510219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:13.082324 run osmo-msc_10.42.42.6(pid=26857): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26857)] 04:35:13.130271 run osmo-msc_10.42.42.6(pid=26857): stdout: | (launched: 2022-12-10_04:35:12.005754) 04:35:13.179524 run osmo-msc_10.42.42.6(pid=26857): stderr: | 20221210043512280 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043512280 DLGLOBAL DEBUG validating counter group 0x7f39c148bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043512280 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043512280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043512280 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043512280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043512283 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043512283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043512283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043512283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:13.229213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26850): Terminating (SIGTERM) 04:35:13.268865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26853): Terminating (SIGTERM) 04:35:13.308489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26856): Terminating (SIGTERM) 04:35:13.348537 --- ParallelTerminationStrategy: PID 26850 died... 04:35:13.367530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26850): Terminated: ok {rc=0} 04:35:13.411743 --- ParallelTerminationStrategy: PID 26853 died... 04:35:13.430435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26853): Terminated: ok {rc=0} 04:35:13.474245 --- ParallelTerminationStrategy: PID 26856 died... 04:35:13.492852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26856): Terminated: ok {rc=0} 04:35:13.575092 bus /sierra_3: Setting Powered False 04:35:14.671106 bus /sierra_3: Setting Powered False 04:35:15.786626 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:35:16.954651 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:16.967870 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:35:17.032853 tst mo_mt_call_osmux.py: using LAC 26028 04:35:17.186879 tst mo_mt_call_osmux.py: using RAC 18 04:35:17.313744 tst mo_mt_call_osmux.py: using CellId 26028 04:35:17.432378 tst mo_mt_call_osmux.py: using BVCI 26029 04:35:17.541298 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:17.552526 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:17.564121 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:17.575781 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:17.587316 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:35:17.598536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:35:17.715989 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:35:17.834705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:18.333034 run create_hlr_db(pid=26859): Launched 04:35:18.463747 bus /sierra_2: Setting Powered False 04:35:19.527132 run create_hlr_db(pid=26859): Terminated: ok {rc=0} 04:35:19.958229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26861): Launched 04:35:20.260580 run osmo-hlr_10.42.42.2(pid=26862): Launched 04:35:20.376003 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:20.899406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26864): Launched 04:35:21.201647 run osmo-stp_10.42.42.5(pid=26865): Launched 04:35:21.316642 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:21.862389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26867): Launched 04:35:22.164282 run osmo-msc_10.42.42.6(pid=26868): Launched 04:35:22.333583 run osmo-stp_10.42.42.5(pid=26865): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26865)] 04:35:22.462142 run osmo-stp_10.42.42.5(pid=26865): stdout: | (launched: 2022-12-10_04:35:21.145934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:22.590470 run osmo-stp_10.42.42.5(pid=26865): stderr: | 20221210043521316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043521316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043521317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043521317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043521318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043521318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043521318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:22.716380 run osmo-stp_10.42.42.5(pid=26865): stdout: | (launched: 2022-12-10_04:35:21.145934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:22.836491 run osmo-stp_10.42.42.5(pid=26865): stderr: | 20221210043521316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043521316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043521317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043521317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043521318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043521318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043521318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:22.979894 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26865): Process ended prematurely: osmo-stp_10.42.42.5(pid=26865) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26865)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:35:22.989024 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:35:23.015950 run osmo-hlr_10.42.42.2(pid=26862): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26862)] 04:35:23.063228 run osmo-hlr_10.42.42.2(pid=26862): stdout: | (launched: 2022-12-10_04:35:20.205119) 04:35:23.112351 run osmo-hlr_10.42.42.2(pid=26862): stderr: | 20221210043520383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043520383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043520383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043520383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043520383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043520383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043520395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043520404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043520404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043520405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:23.180833 run osmo-msc_10.42.42.6(pid=26868): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26868)] 04:35:23.227939 run osmo-msc_10.42.42.6(pid=26868): stdout: | (launched: 2022-12-10_04:35:22.108731) 04:35:23.276866 run osmo-msc_10.42.42.6(pid=26868): stderr: | 20221210043522379 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043522379 DLGLOBAL DEBUG validating counter group 0x7f6c6eac4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043522379 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043522379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043522380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043522380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043522381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043522382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043522382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043522382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:23.326210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26861): Terminating (SIGTERM) 04:35:23.365809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26864): Terminating (SIGTERM) 04:35:23.405479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26867): Terminating (SIGTERM) 04:35:23.445164 --- ParallelTerminationStrategy: PID 26861 died... 04:35:23.463923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26861): Terminated: ok {rc=0} 04:35:23.507814 --- ParallelTerminationStrategy: PID 26864 died... 04:35:23.526327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26864): Terminated: ok {rc=0} 04:35:23.569991 --- ParallelTerminationStrategy: PID 26867 died... 04:35:23.588479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26867): Terminated: ok {rc=0} 04:35:23.673198 bus /sierra_3: Setting Powered False 04:35:24.771298 bus /sierra_3: Setting Powered False 04:35:25.885722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:35:27.125300 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:27.132412 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:35:27.157844 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:35:27.184870 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:35:27.237398 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:35:27.260586 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:35:27.288113 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:35:27.839343 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:35:27.888748 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:27.899952 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:35:27.958157 tst mo_mt_call.py: using LAC 26029 04:35:28.084350 tst mo_mt_call.py: using RAC 19 04:35:28.208498 tst mo_mt_call.py: using CellId 26029 04:35:28.332161 tst mo_mt_call.py: using BVCI 26030 04:35:28.449115 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:28.460929 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:28.472608 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:28.484037 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:28.495586 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:28.507024 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:35:28.621777 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:35:28.737294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:29.206285 run create_hlr_db(pid=26873): Launched 04:35:29.321500 bus /sierra_2: Setting Powered False 04:35:30.382112 run create_hlr_db(pid=26873): Terminated: ok {rc=0} 04:35:30.821406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26875): Launched 04:35:31.143761 run osmo-hlr_10.42.42.2(pid=26876): Launched 04:35:31.294226 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:32.146117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26878): Launched 04:35:32.530342 run osmo-stp_10.42.42.5(pid=26879): Launched 04:35:32.675324 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:33.258797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26881): Launched 04:35:33.582251 run osmo-msc_10.42.42.6(pid=26882): Launched 04:35:33.762179 run osmo-stp_10.42.42.5(pid=26879): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26879)] 04:35:33.897282 run osmo-stp_10.42.42.5(pid=26879): stdout: | (launched: 2022-12-10_04:35:32.467788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:34.034331 run osmo-stp_10.42.42.5(pid=26879): stderr: | 20221210043532675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043532675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043532675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043532676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043532676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043532676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043532676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:34.171374 run osmo-stp_10.42.42.5(pid=26879): stdout: | (launched: 2022-12-10_04:35:32.467788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:34.299748 run osmo-stp_10.42.42.5(pid=26879): stderr: | 20221210043532675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043532675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043532675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043532676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043532676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043532676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043532676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:34.454052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26879): Process ended prematurely: osmo-stp_10.42.42.5(pid=26879) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26879)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:35:34.463759 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 04:35:34.491656 run osmo-hlr_10.42.42.2(pid=26876): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26876)] 04:35:34.541505 run osmo-hlr_10.42.42.2(pid=26876): stdout: | (launched: 2022-12-10_04:35:31.084409) 04:35:34.593106 run osmo-hlr_10.42.42.2(pid=26876): stderr: | 20221210043531485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043531485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043531485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043531485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043531485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043531485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043531503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043531520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043531520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043531520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:34.665081 run osmo-msc_10.42.42.6(pid=26882): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26882)] 04:35:34.714899 run osmo-msc_10.42.42.6(pid=26882): stdout: | (launched: 2022-12-10_04:35:33.523542) 04:35:34.766192 run osmo-msc_10.42.42.6(pid=26882): stderr: | 20221210043533844 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043533844 DLGLOBAL DEBUG validating counter group 0x7f34c9c1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043533844 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043533844 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043533844 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043533845 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043533846 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043533847 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043533847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043533847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:34.817723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26875): Terminating (SIGTERM) 04:35:34.858960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26878): Terminating (SIGTERM) 04:35:34.900573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26881): Terminating (SIGTERM) 04:35:34.942298 --- ParallelTerminationStrategy: PID 26875 died... 04:35:34.962277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26875): Terminated: ok {rc=0} 04:35:35.008361 --- ParallelTerminationStrategy: PID 26878 died... 04:35:35.027926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26878): Terminated: ok {rc=0} 04:35:35.073675 --- ParallelTerminationStrategy: PID 26881 died... 04:35:35.093270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26881): Terminated: ok {rc=0} 04:35:35.180207 bus /sierra_3: Setting Powered False 04:35:36.279487 bus /sierra_3: Setting Powered False 04:35:37.394458 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:35:38.543636 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:38.556028 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:35:38.618801 tst mo_mt_call_osmux.py: using LAC 26030 04:35:38.745398 tst mo_mt_call_osmux.py: using RAC 20 04:35:38.875678 tst mo_mt_call_osmux.py: using CellId 26030 04:35:39.001323 tst mo_mt_call_osmux.py: using BVCI 26031 04:35:39.117985 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:39.129722 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:39.141311 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:39.152848 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:39.164561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:35:39.176146 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:35:39.292931 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:35:39.412590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:39.909657 run create_hlr_db(pid=26884): Launched 04:35:40.040335 bus /sierra_2: Setting Powered False 04:35:41.104537 run create_hlr_db(pid=26884): Terminated: ok {rc=0} 04:35:41.535829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26886): Launched 04:35:41.838460 run osmo-hlr_10.42.42.2(pid=26887): Launched 04:35:41.953608 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:42.488696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26889): Launched 04:35:42.793220 run osmo-stp_10.42.42.5(pid=26890): Launched 04:35:42.908668 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:43.455907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26892): Launched 04:35:43.758692 run osmo-msc_10.42.42.6(pid=26893): Launched 04:35:43.939751 run osmo-stp_10.42.42.5(pid=26890): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26890)] 04:35:44.077998 run osmo-stp_10.42.42.5(pid=26890): stdout: | (launched: 2022-12-10_04:35:42.737276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:44.215393 run osmo-stp_10.42.42.5(pid=26890): stderr: | 20221210043542908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043542908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043542908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043542908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043542909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043542909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043542909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:44.350489 run osmo-stp_10.42.42.5(pid=26890): stdout: | (launched: 2022-12-10_04:35:42.737276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:44.479005 run osmo-stp_10.42.42.5(pid=26890): stderr: | 20221210043542908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043542908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043542908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043542908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043542909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043542909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043542909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:44.632811 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26890): Process ended prematurely: osmo-stp_10.42.42.5(pid=26890) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26890)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:35:44.642735 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:35:44.670622 run osmo-hlr_10.42.42.2(pid=26887): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26887)] 04:35:44.720727 run osmo-hlr_10.42.42.2(pid=26887): stdout: | (launched: 2022-12-10_04:35:41.783154) 04:35:44.772452 run osmo-hlr_10.42.42.2(pid=26887): stderr: | 20221210043541960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043541960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043541960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043541960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043541960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043541960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043541972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043541981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043541981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043541981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:44.844447 run osmo-msc_10.42.42.6(pid=26893): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26893)] 04:35:44.894187 run osmo-msc_10.42.42.6(pid=26893): stdout: | (launched: 2022-12-10_04:35:43.703080) 04:35:44.945395 run osmo-msc_10.42.42.6(pid=26893): stderr: | 20221210043544022 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043544022 DLGLOBAL DEBUG validating counter group 0x7f7d3575ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043544022 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043544023 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043544023 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043544023 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043544025 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043544025 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043544025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043544025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:44.997342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26886): Terminating (SIGTERM) 04:35:45.038780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26889): Terminating (SIGTERM) 04:35:45.080056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26892): Terminating (SIGTERM) 04:35:45.121845 --- ParallelTerminationStrategy: PID 26886 died... 04:35:45.141730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26886): Terminated: ok {rc=0} 04:35:45.187800 --- ParallelTerminationStrategy: PID 26889 died... 04:35:45.207338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26889): Terminated: ok {rc=0} 04:35:45.252675 --- ParallelTerminationStrategy: PID 26892 died... 04:35:45.272221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26892): Terminated: ok {rc=0} 04:35:45.358794 bus /sierra_3: Setting Powered False 04:35:46.454488 bus /sierra_3: Setting Powered False 04:35:47.571711 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:35:48.815967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:48.824093 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:35:48.849232 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:35:48.876673 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:35:48.930810 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:35:48.955754 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:35:48.983453 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:35:49.535541 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:35:49.587333 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:35:49.599197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:35:49.660049 tst mo_mt_call.py: using LAC 26031 04:35:49.786295 tst mo_mt_call.py: using RAC 21 04:35:49.913411 tst mo_mt_call.py: using CellId 26031 04:35:50.038537 tst mo_mt_call.py: using BVCI 26032 04:35:50.155396 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:35:50.167192 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:35:50.178723 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:35:50.190258 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:35:50.202003 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:35:50.213599 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:35:50.327713 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:35:50.443968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:50.910650 run create_hlr_db(pid=26898): Launched 04:35:51.026091 bus /sierra_2: Setting Powered False 04:35:52.086778 run create_hlr_db(pid=26898): Terminated: ok {rc=0} 04:35:52.508857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Launched 04:35:52.810917 run osmo-hlr_10.42.42.2(pid=26901): Launched 04:35:52.926764 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:53.445636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Launched 04:35:53.747366 run osmo-stp_10.42.42.5(pid=26904): Launched 04:35:53.862523 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:54.410164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26906): Launched 04:35:54.711748 run osmo-msc_10.42.42.6(pid=26907): Launched 04:35:54.881565 run osmo-stp_10.42.42.5(pid=26904): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] 04:35:55.010026 run osmo-stp_10.42.42.5(pid=26904): stdout: | (launched: 2022-12-10_04:35:53.691787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:55.138193 run osmo-stp_10.42.42.5(pid=26904): stderr: | 20221210043553861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043553861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043553861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043553862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043553864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043553864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043553864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:55.264056 run osmo-stp_10.42.42.5(pid=26904): stdout: | (launched: 2022-12-10_04:35:53.691787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:55.384038 run osmo-stp_10.42.42.5(pid=26904): stderr: | 20221210043553861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043553861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043553861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043553862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043553864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043553864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043553864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:55.527749 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26904): Process ended prematurely: osmo-stp_10.42.42.5(pid=26904) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:35:55.536745 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:35:55.563658 run osmo-hlr_10.42.42.2(pid=26901): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26901)] 04:35:55.610911 run osmo-hlr_10.42.42.2(pid=26901): stdout: | (launched: 2022-12-10_04:35:52.755674) 04:35:55.660016 run osmo-hlr_10.42.42.2(pid=26901): stderr: | 20221210043552930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043552930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043552930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043552931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043552931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043552931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043552943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043552952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043552952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043552952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:55.728747 run osmo-msc_10.42.42.6(pid=26907): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26907)] 04:35:55.775994 run osmo-msc_10.42.42.6(pid=26907): stdout: | (launched: 2022-12-10_04:35:54.656273) 04:35:55.825217 run osmo-msc_10.42.42.6(pid=26907): stderr: | 20221210043554926 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043554926 DLGLOBAL DEBUG validating counter group 0x7f50eae97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043554926 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043554926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043554926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043554927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043554930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043554931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043554931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043554931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:55.874637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Terminating (SIGTERM) 04:35:55.913863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Terminating (SIGTERM) 04:35:55.953750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26906): Terminating (SIGTERM) 04:35:55.993531 --- ParallelTerminationStrategy: PID 26900 died... 04:35:56.012405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Terminated: ok {rc=0} 04:35:56.056331 --- ParallelTerminationStrategy: PID 26903 died... 04:35:56.074768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Terminated: ok {rc=0} 04:35:56.118500 --- ParallelTerminationStrategy: PID 26906 died... 04:35:56.136929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26906): Terminated: ok {rc=0} 04:35:56.222950 bus /sierra_3: Setting Powered False 04:35:57.321194 bus /sierra_3: Setting Powered False 04:35:58.435668 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:35:59.581028 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:35:59.592733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:35:59.652828 tst mo_mt_call_osmux.py: using LAC 26032 04:35:59.771696 tst mo_mt_call_osmux.py: using RAC 22 04:35:59.890549 tst mo_mt_call_osmux.py: using CellId 26032 04:36:00.009448 tst mo_mt_call_osmux.py: using BVCI 26033 04:36:00.127158 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:00.139102 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:00.150942 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:00.164704 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:00.176337 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:00.187456 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:00.302403 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:00.417589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:00.897772 run create_hlr_db(pid=26909): Launched 04:36:01.015475 bus /sierra_2: Setting Powered False 04:36:02.088487 run create_hlr_db(pid=26909): Terminated: ok {rc=0} 04:36:02.563629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26911): Launched 04:36:02.885295 run osmo-hlr_10.42.42.2(pid=26912): Launched 04:36:03.007820 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:03.561268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26914): Launched 04:36:03.864880 run osmo-stp_10.42.42.5(pid=26915): Launched 04:36:03.979858 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:04.533159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26917): Launched 04:36:04.836843 run osmo-msc_10.42.42.6(pid=26918): Launched 04:36:05.007722 run osmo-stp_10.42.42.5(pid=26915): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26915)] 04:36:05.136364 run osmo-stp_10.42.42.5(pid=26915): stdout: | (launched: 2022-12-10_04:36:03.809015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:05.265197 run osmo-stp_10.42.42.5(pid=26915): stderr: | 20221210043603979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043603979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043603980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043603980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043603982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043603982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043603983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:05.391309 run osmo-stp_10.42.42.5(pid=26915): stdout: | (launched: 2022-12-10_04:36:03.809015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:05.511902 run osmo-stp_10.42.42.5(pid=26915): stderr: | 20221210043603979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043603979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043603980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043603980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043603982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043603982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043603983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:05.657047 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26915): Process ended prematurely: osmo-stp_10.42.42.5(pid=26915) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26915)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:36:05.666163 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:36:05.692903 run osmo-hlr_10.42.42.2(pid=26912): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26912)] 04:36:05.741144 run osmo-hlr_10.42.42.2(pid=26912): stdout: | (launched: 2022-12-10_04:36:02.826540) 04:36:05.790523 run osmo-hlr_10.42.42.2(pid=26912): stderr: | 20221210043603026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043603026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043603026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043603026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043603026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043603026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043603039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043603047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043603047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043603047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:05.859372 run osmo-msc_10.42.42.6(pid=26918): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26918)] 04:36:05.906883 run osmo-msc_10.42.42.6(pid=26918): stdout: | (launched: 2022-12-10_04:36:04.780855) 04:36:05.955917 run osmo-msc_10.42.42.6(pid=26918): stderr: | 20221210043605051 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043605051 DLGLOBAL DEBUG validating counter group 0x7f0c119a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043605051 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043605051 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043605052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043605052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043605054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043605054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043605054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043605054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:06.005515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26911): Terminating (SIGTERM) 04:36:06.045539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26914): Terminating (SIGTERM) 04:36:06.085399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26917): Terminating (SIGTERM) 04:36:06.125572 --- ParallelTerminationStrategy: PID 26911 died... 04:36:06.144557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26911): Terminated: ok {rc=0} 04:36:06.188704 --- ParallelTerminationStrategy: PID 26914 died... 04:36:06.207251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26914): Terminated: ok {rc=0} 04:36:06.252064 --- ParallelTerminationStrategy: PID 26917 died... 04:36:06.270826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26917): Terminated: ok {rc=0} 04:36:06.356187 bus /sierra_3: Setting Powered False 04:36:07.455363 bus /sierra_3: Setting Powered False 04:36:08.570721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:36:09.818728 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:09.826728 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:36:09.851704 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:36:09.879424 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:36:09.932627 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:36:09.957097 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:36:09.985036 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:36:10.538932 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:36:10.590790 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:10.602640 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:36:10.663803 tst mo_mt_call.py: using LAC 26033 04:36:10.783482 tst mo_mt_call.py: using RAC 23 04:36:10.902658 tst mo_mt_call.py: using CellId 26033 04:36:11.021396 tst mo_mt_call.py: using BVCI 26034 04:36:11.130183 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:11.141475 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:11.152660 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:11.163989 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:11.175321 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:11.186569 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:36:11.304418 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:36:11.422667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:11.889873 run create_hlr_db(pid=26923): Launched 04:36:12.004367 bus /sierra_2: Setting Powered False 04:36:13.065046 run create_hlr_db(pid=26923): Terminated: ok {rc=0} 04:36:13.485100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26925): Launched 04:36:13.787458 run osmo-hlr_10.42.42.2(pid=26926): Launched 04:36:13.902450 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:14.420354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26928): Launched 04:36:14.723233 run osmo-stp_10.42.42.5(pid=26929): Launched 04:36:14.838524 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:15.384113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26931): Launched 04:36:15.686878 run osmo-msc_10.42.42.6(pid=26932): Launched 04:36:15.929405 run osmo-stp_10.42.42.5(pid=26929): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26929)] 04:36:16.202480 run osmo-stp_10.42.42.5(pid=26929): stdout: | (launched: 2022-12-10_04:36:14.667530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:16.333053 run osmo-stp_10.42.42.5(pid=26929): stderr: | 20221210043614838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043614839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043614839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043614839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043614840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043614840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043614840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:16.463925 run osmo-stp_10.42.42.5(pid=26929): stdout: | (launched: 2022-12-10_04:36:14.667530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:16.588188 run osmo-stp_10.42.42.5(pid=26929): stderr: | 20221210043614838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043614839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043614839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043614839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043614840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043614840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043614840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:16.737456 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26929): Process ended prematurely: osmo-stp_10.42.42.5(pid=26929) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26929)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:36:16.747543 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:36:16.777775 run osmo-hlr_10.42.42.2(pid=26926): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26926)] 04:36:16.828313 run osmo-hlr_10.42.42.2(pid=26926): stdout: | (launched: 2022-12-10_04:36:13.731922) 04:36:16.880553 run osmo-hlr_10.42.42.2(pid=26926): stderr: | 20221210043613906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043613906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043613907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043613907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043613907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043613907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043613919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043613928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043613928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043613928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:16.952470 run osmo-msc_10.42.42.6(pid=26932): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26932)] 04:36:17.002918 run osmo-msc_10.42.42.6(pid=26932): stdout: | (launched: 2022-12-10_04:36:15.631194) 04:36:17.054916 run osmo-msc_10.42.42.6(pid=26932): stderr: | 20221210043615904 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043615904 DLGLOBAL DEBUG validating counter group 0x7f8bdb2a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043615909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043615909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043615909 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043615909 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043615911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043615911 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043615912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043615912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:17.107645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26925): Terminating (SIGTERM) 04:36:17.149947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26928): Terminating (SIGTERM) 04:36:17.192078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26931): Terminating (SIGTERM) 04:36:17.234741 --- ParallelTerminationStrategy: PID 26925 died... 04:36:17.254501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26925): Terminated: ok {rc=0} 04:36:17.302004 --- ParallelTerminationStrategy: PID 26928 died... 04:36:17.320298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26928): Terminated: ok {rc=0} 04:36:17.365647 --- ParallelTerminationStrategy: PID 26931 died... 04:36:17.384102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26931): Terminated: ok {rc=0} 04:36:17.470642 bus /sierra_3: Setting Powered False 04:36:18.571676 bus /sierra_3: Setting Powered False 04:36:19.687125 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:36:20.833210 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:20.845004 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:36:20.904661 tst mo_mt_call_osmux.py: using LAC 26034 04:36:21.027608 tst mo_mt_call_osmux.py: using RAC 24 04:36:21.145374 tst mo_mt_call_osmux.py: using CellId 26034 04:36:21.261973 tst mo_mt_call_osmux.py: using BVCI 26035 04:36:21.373180 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:21.384295 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:21.395316 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:21.406535 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:21.417839 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:36:21.429025 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:36:21.544285 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:36:21.663268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:22.164303 run create_hlr_db(pid=26934): Launched 04:36:22.294681 bus /sierra_2: Setting Powered False 04:36:23.359264 run create_hlr_db(pid=26934): Terminated: ok {rc=0} 04:36:23.791858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26936): Launched 04:36:24.094490 run osmo-hlr_10.42.42.2(pid=26937): Launched 04:36:24.209278 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:24.745057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26939): Launched 04:36:25.047613 run osmo-stp_10.42.42.5(pid=26940): Launched 04:36:25.162363 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:25.707066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26942): Launched 04:36:26.009388 run osmo-msc_10.42.42.6(pid=26943): Launched 04:36:26.178867 run osmo-stp_10.42.42.5(pid=26940): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26940)] 04:36:26.307107 run osmo-stp_10.42.42.5(pid=26940): stdout: | (launched: 2022-12-10_04:36:24.991838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:26.435511 run osmo-stp_10.42.42.5(pid=26940): stderr: | 20221210043625164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043625164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043625165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043625165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043625165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043625166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043625166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:26.560865 run osmo-stp_10.42.42.5(pid=26940): stdout: | (launched: 2022-12-10_04:36:24.991838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:26.681249 run osmo-stp_10.42.42.5(pid=26940): stderr: | 20221210043625164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043625164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043625165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043625165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043625165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043625166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043625166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:26.824700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26940): Process ended prematurely: osmo-stp_10.42.42.5(pid=26940) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26940)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:36:26.833798 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:36:26.860599 run osmo-hlr_10.42.42.2(pid=26937): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26937)] 04:36:26.908165 run osmo-hlr_10.42.42.2(pid=26937): stdout: | (launched: 2022-12-10_04:36:24.039037) 04:36:26.957409 run osmo-hlr_10.42.42.2(pid=26937): stderr: | 20221210043624216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043624216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043624216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043624216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043624216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043624217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043624229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043624239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043624239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043624239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:27.026401 run osmo-msc_10.42.42.6(pid=26943): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26943)] 04:36:27.074003 run osmo-msc_10.42.42.6(pid=26943): stdout: | (launched: 2022-12-10_04:36:25.953717) 04:36:27.123392 run osmo-msc_10.42.42.6(pid=26943): stderr: | 20221210043626225 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043626225 DLGLOBAL DEBUG validating counter group 0x7f7fda451c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043626225 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043626225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043626225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043626226 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043626228 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043626228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043626228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043626229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:27.172836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26936): Terminating (SIGTERM) 04:36:27.212148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26939): Terminating (SIGTERM) 04:36:27.251534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26942): Terminating (SIGTERM) 04:36:27.291166 --- ParallelTerminationStrategy: PID 26936 died... 04:36:27.310035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26936): Terminated: ok {rc=0} 04:36:27.353977 --- ParallelTerminationStrategy: PID 26939 died... 04:36:27.372270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26939): Terminated: ok {rc=0} 04:36:27.416343 --- ParallelTerminationStrategy: PID 26942 died... 04:36:27.434701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26942): Terminated: ok {rc=0} 04:36:27.519705 bus /sierra_3: Setting Powered False 04:36:28.616657 bus /sierra_3: Setting Powered False 04:36:29.731781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:36:31.002299 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:31.010433 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:36:31.038816 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:36:31.067678 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:36:31.122164 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:36:31.154755 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:36:31.190163 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:36:31.726282 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:36:31.785861 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:31.798524 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:36:31.861275 tst mo_mt_call.py: using LAC 26035 04:36:32.011246 tst mo_mt_call.py: using RAC 25 04:36:32.140841 tst mo_mt_call.py: using CellId 26035 04:36:32.261241 tst mo_mt_call.py: using BVCI 26036 04:36:32.371715 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:32.383076 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:32.394299 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:32.406183 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:32.418922 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:32.430229 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:36:32.550478 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:36:32.666929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:33.135065 run create_hlr_db(pid=26948): Launched 04:36:33.251292 bus /sierra_2: Setting Powered False 04:36:34.311341 run create_hlr_db(pid=26948): Terminated: ok {rc=0} 04:36:34.750908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26950): Launched 04:36:35.072557 run osmo-hlr_10.42.42.2(pid=26951): Launched 04:36:35.194942 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:35.752463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26953): Launched 04:36:36.073629 run osmo-stp_10.42.42.5(pid=26954): Launched 04:36:36.195994 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:36.781207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26956): Launched 04:36:37.102301 run osmo-msc_10.42.42.6(pid=26957): Launched 04:36:37.280749 run osmo-stp_10.42.42.5(pid=26954): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26954)] 04:36:37.416227 run osmo-stp_10.42.42.5(pid=26954): stdout: | (launched: 2022-12-10_04:36:36.014967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:37.553572 run osmo-stp_10.42.42.5(pid=26954): stderr: | 20221210043636207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043636207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043636208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043636208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043636209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043636209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043636209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:37.688164 run osmo-stp_10.42.42.5(pid=26954): stdout: | (launched: 2022-12-10_04:36:36.014967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:37.816274 run osmo-stp_10.42.42.5(pid=26954): stderr: | 20221210043636207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043636207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043636208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043636208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043636209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043636209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043636209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:37.969207 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26954): Process ended prematurely: osmo-stp_10.42.42.5(pid=26954) [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26954)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:36:37.979134 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:36:38.007478 run osmo-hlr_10.42.42.2(pid=26951): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26951)] 04:36:38.057585 run osmo-hlr_10.42.42.2(pid=26951): stdout: | (launched: 2022-12-10_04:36:35.014073) 04:36:38.109414 run osmo-hlr_10.42.42.2(pid=26951): stderr: | 20221210043635213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043635213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043635213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043635213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043635213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043635213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043635226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043635234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043635235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043635235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:38.181622 run osmo-msc_10.42.42.6(pid=26957): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26957)] 04:36:38.231481 run osmo-msc_10.42.42.6(pid=26957): stdout: | (launched: 2022-12-10_04:36:37.043090) 04:36:38.282943 run osmo-msc_10.42.42.6(pid=26957): stderr: | 20221210043637365 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043637365 DLGLOBAL DEBUG validating counter group 0x7f35d0297c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043637365 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043637365 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043637365 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043637365 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043637369 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043637369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043637369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043637369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:38.334640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26950): Terminating (SIGTERM) 04:36:38.376217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26953): Terminating (SIGTERM) 04:36:38.417634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26956): Terminating (SIGTERM) 04:36:38.459895 --- ParallelTerminationStrategy: PID 26950 died... 04:36:38.479947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26950): Terminated: ok {rc=0} 04:36:38.526989 --- ParallelTerminationStrategy: PID 26953 died... 04:36:38.546673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26953): Terminated: ok {rc=0} 04:36:38.592646 --- ParallelTerminationStrategy: PID 26956 died... 04:36:38.612278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26956): Terminated: ok {rc=0} 04:36:38.699493 bus /sierra_3: Setting Powered False 04:36:39.798353 bus /sierra_3: Setting Powered False 04:36:40.913724 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:36:42.064141 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:42.076627 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:36:42.138698 tst mo_mt_call_osmux.py: using LAC 26036 04:36:42.265373 tst mo_mt_call_osmux.py: using RAC 26 04:36:42.391385 tst mo_mt_call_osmux.py: using CellId 26036 04:36:42.518288 tst mo_mt_call_osmux.py: using BVCI 26037 04:36:42.636247 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:42.648100 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:42.659660 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:42.671452 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:42.683399 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:36:42.695313 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:36:42.809967 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:36:42.927405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:43.424430 run create_hlr_db(pid=26959): Launched 04:36:43.555334 bus /sierra_2: Setting Powered False 04:36:44.618941 run create_hlr_db(pid=26959): Terminated: ok {rc=0} 04:36:45.066252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26961): Launched 04:36:45.387369 run osmo-hlr_10.42.42.2(pid=26962): Launched 04:36:45.509961 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:46.092313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26964): Launched 04:36:46.423794 run osmo-stp_10.42.42.5(pid=26965): Launched 04:36:46.671512 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:47.378281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26967): Launched 04:36:47.682432 run osmo-msc_10.42.42.6(pid=26968): Launched 04:36:47.851492 run osmo-stp_10.42.42.5(pid=26965): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26965)] 04:36:47.979518 run osmo-stp_10.42.42.5(pid=26965): stdout: | (launched: 2022-12-10_04:36:46.360044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:48.107305 run osmo-stp_10.42.42.5(pid=26965): stderr: | 20221210043646707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043646707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043646708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043646708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043646708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043646708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043646709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:48.233393 run osmo-stp_10.42.42.5(pid=26965): stdout: | (launched: 2022-12-10_04:36:46.360044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:48.354038 run osmo-stp_10.42.42.5(pid=26965): stderr: | 20221210043646707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043646707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043646708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043646708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043646708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043646708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043646709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:48.498710 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26965): Process ended prematurely: osmo-stp_10.42.42.5(pid=26965) [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26965)] [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:36:48.507770 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:36:48.535322 run osmo-hlr_10.42.42.2(pid=26962): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26962)] 04:36:48.583101 run osmo-hlr_10.42.42.2(pid=26962): stdout: | (launched: 2022-12-10_04:36:45.328920) 04:36:48.632817 run osmo-hlr_10.42.42.2(pid=26962): stderr: | 20221210043645527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043645527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043645527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043645527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043645527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043645527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043645540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043645549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043645550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043645550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:48.701670 run osmo-msc_10.42.42.6(pid=26968): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26968)] 04:36:48.749135 run osmo-msc_10.42.42.6(pid=26968): stdout: | (launched: 2022-12-10_04:36:47.626264) 04:36:48.798471 run osmo-msc_10.42.42.6(pid=26968): stderr: | 20221210043647897 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043647897 DLGLOBAL DEBUG validating counter group 0x7fd87f31dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043647897 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043647897 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043647897 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043647898 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043647899 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043647900 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043647900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043647901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:48.848262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26961): Terminating (SIGTERM) 04:36:48.888009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26964): Terminating (SIGTERM) 04:36:48.927837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26967): Terminating (SIGTERM) 04:36:48.967784 --- ParallelTerminationStrategy: PID 26961 died... 04:36:48.986894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26961): Terminated: ok {rc=0} 04:36:49.031333 --- ParallelTerminationStrategy: PID 26964 died... 04:36:49.050080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26964): Terminated: ok {rc=0} 04:36:49.094470 --- ParallelTerminationStrategy: PID 26967 died... 04:36:49.113264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26967): Terminated: ok {rc=0} 04:36:49.199234 bus /sierra_3: Setting Powered False 04:36:50.297367 bus /sierra_3: Setting Powered False 04:36:51.410237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:nanobts+band-1900 --------------------------------------------------------------------- 04:36:52.652506 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:52.658362 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:36:52.682793 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:36:52.710264 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 04:36:52.797624 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:36:52.822006 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:36:52.849827 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 04:36:53.436088 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 04:36:53.441570 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:53.453301 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:36:53.492523 tst emergency_mo_mt_call.py: using LAC 26037 04:36:53.615863 tst emergency_mo_mt_call.py: using RAC 27 04:36:53.734693 tst emergency_mo_mt_call.py: using CellId 26037 04:36:53.855771 tst emergency_mo_mt_call.py: using BVCI 26038 04:36:53.965742 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:53.976612 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:53.987583 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:53.999928 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:54.010769 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:36:54.022127 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:36:54.139165 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:36:54.255974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:54.738804 run create_hlr_db(pid=26974): Launched 04:36:54.865377 bus /sierra_2: Setting Powered False 04:36:55.927164 run create_hlr_db(pid=26974): Terminated: ok {rc=0} 04:36:56.358486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26976): Launched 04:36:56.668866 run osmo-hlr_10.42.42.2(pid=26977): Launched 04:36:56.786666 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:57.321344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26979): Launched 04:36:57.631078 run osmo-stp_10.42.42.5(pid=26980): Launched 04:36:57.758294 tst emergency_mo_mt_call.py: using MSISDN 7551 04:36:57.917766 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:58.475060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26982): Launched 04:36:58.784791 run osmo-msc_10.42.42.6(pid=26983): Launched 04:36:58.956795 run osmo-stp_10.42.42.5(pid=26980): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26980)] 04:36:59.087187 run osmo-stp_10.42.42.5(pid=26980): stdout: | (launched: 2022-12-10_04:36:57.574677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:59.218445 run osmo-stp_10.42.42.5(pid=26980): stderr: | 20221210043657764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043657764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043657764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043657765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043657765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043657765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043657765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:59.348695 run osmo-stp_10.42.42.5(pid=26980): stdout: | (launched: 2022-12-10_04:36:57.574677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:59.472499 run osmo-stp_10.42.42.5(pid=26980): stderr: | 20221210043657764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043657764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043657764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043657765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043657765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043657765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043657765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:59.620523 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26980): Process ended prematurely: osmo-stp_10.42.42.5(pid=26980) [trial-2369↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26980)] [trial-2369↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 04:36:59.629705 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 04:36:59.657070 run osmo-hlr_10.42.42.2(pid=26977): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26977)] 04:36:59.706082 run osmo-hlr_10.42.42.2(pid=26977): stdout: | (launched: 2022-12-10_04:36:56.611891) 04:36:59.757201 run osmo-hlr_10.42.42.2(pid=26977): stderr: | 20221210043656811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043656811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043656811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043656811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043656811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043656811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043656823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043656834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043656834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043656834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:59.828152 run osmo-msc_10.42.42.6(pid=26983): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26983)] 04:36:59.877140 run osmo-msc_10.42.42.6(pid=26983): stdout: | (launched: 2022-12-10_04:36:58.728273) 04:36:59.927188 run osmo-msc_10.42.42.6(pid=26983): stderr: | 20221210043659050 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043659050 DLGLOBAL DEBUG validating counter group 0x7f4c4f599c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043659050 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043659050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043659050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043659050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043659052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043659053 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043659053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043659053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:59.977629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26976): Terminating (SIGTERM) 04:37:00.018459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26979): Terminating (SIGTERM) 04:37:00.059226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26982): Terminating (SIGTERM) 04:37:00.100205 --- ParallelTerminationStrategy: PID 26976 died... 04:37:00.119975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26976): Terminated: ok {rc=0} 04:37:00.165369 --- ParallelTerminationStrategy: PID 26979 died... 04:37:00.184388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26979): Terminated: ok {rc=0} 04:37:00.229788 --- ParallelTerminationStrategy: PID 26982 died... 04:37:00.249089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26982): Terminated: ok {rc=0} 04:37:00.334205 bus /sierra_3: Setting Powered False 04:37:01.430307 bus /sierra_3: Setting Powered False 04:37:02.545354 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 04:37:03.631137 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:03.642870 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:37:03.687471 tst emergency_preemptive_call.py: using LAC 26038 04:37:03.801928 tst emergency_preemptive_call.py: using RAC 28 04:37:03.915868 tst emergency_preemptive_call.py: using CellId 26038 04:37:04.030651 tst emergency_preemptive_call.py: using BVCI 26039 04:37:04.135525 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:04.146698 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:04.157450 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:04.168491 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:04.179303 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:04.190111 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:04.303549 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:04.416285 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:04.532566 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:04.645639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:05.097384 run create_hlr_db(pid=26985): Launched 04:37:05.207883 bus /sierra_2: Setting Powered False 04:37:06.267245 run create_hlr_db(pid=26985): Terminated: ok {rc=0} 04:37:06.691291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26987): Launched 04:37:07.001704 run osmo-hlr_10.42.42.2(pid=26988): Launched 04:37:07.119736 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:07.657922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26990): Launched 04:37:07.966944 run osmo-stp_10.42.42.5(pid=26991): Launched 04:37:08.094810 tst emergency_preemptive_call.py: using MSISDN 7552 04:37:08.253440 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:08.811189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26993): Launched 04:37:09.121631 run osmo-msc_10.42.42.6(pid=26994): Launched 04:37:09.294102 run osmo-stp_10.42.42.5(pid=26991): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26991)] 04:37:09.424911 run osmo-stp_10.42.42.5(pid=26991): stdout: | (launched: 2022-12-10_04:37:07.910287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:09.556870 run osmo-stp_10.42.42.5(pid=26991): stderr: | 20221210043708099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043708099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043708099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043708100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043708100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043708100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043708100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:09.687091 run osmo-stp_10.42.42.5(pid=26991): stdout: | (launched: 2022-12-10_04:37:07.910287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:09.810725 run osmo-stp_10.42.42.5(pid=26991): stderr: | 20221210043708099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043708099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043708099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043708100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043708100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043708100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043708100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:09.958315 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26991): Process ended prematurely: osmo-stp_10.42.42.5(pid=26991) [trial-2369↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26991)] [trial-2369↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 04:37:09.967168 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 04:37:09.994536 run osmo-hlr_10.42.42.2(pid=26988): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26988)] 04:37:10.043647 run osmo-hlr_10.42.42.2(pid=26988): stdout: | (launched: 2022-12-10_04:37:06.945347) 04:37:10.094341 run osmo-hlr_10.42.42.2(pid=26988): stderr: | 20221210043707141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043707141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043707142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043707142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043707142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043707142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043707154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043707163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043707163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043707163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:10.165369 run osmo-msc_10.42.42.6(pid=26994): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26994)] 04:37:10.214162 run osmo-msc_10.42.42.6(pid=26994): stdout: | (launched: 2022-12-10_04:37:09.063454) 04:37:10.264621 run osmo-msc_10.42.42.6(pid=26994): stderr: | 20221210043709385 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210043709385 DLGLOBAL DEBUG validating counter group 0x7f5ab39f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210043709385 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210043709386 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210043709386 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210043709386 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210043709388 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210043709388 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210043709388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210043709388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:10.315758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26987): Terminating (SIGTERM) 04:37:10.356750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26990): Terminating (SIGTERM) 04:37:10.397947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26993): Terminating (SIGTERM) 04:37:10.439060 --- ParallelTerminationStrategy: PID 26987 died... 04:37:10.459116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26987): Terminated: ok {rc=0} 04:37:10.504697 --- ParallelTerminationStrategy: PID 26990 died... 04:37:10.524140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26990): Terminated: ok {rc=0} 04:37:10.569300 --- ParallelTerminationStrategy: PID 26993 died... 04:37:10.588594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26993): Terminated: ok {rc=0} 04:37:10.674876 bus /sierra_9: Setting Powered False 04:37:11.773286 bus /sierra_9: Setting Powered False 04:37:12.886917 bus /sierra_8: Setting Powered False 04:37:13.983871 bus /sierra_8: Setting Powered False 04:37:15.097244 bus /sierra_3: Setting Powered False 04:37:16.194238 bus /sierra_3: Setting Powered False 04:37:17.320083 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-1900 --------------------------------------------------------------------- 04:37:18.596304 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:37:18.601424 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:37:18.625197 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 04:37:18.663452 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 04:37:18.749081 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:37:18.772251 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 04:37:18.810192 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 04:37:19.401826 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 04:37:19.450356 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:19.461051 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:37:19.499208 tst cs_paging_gprs_active.py: using LAC 26039 04:37:19.616443 tst cs_paging_gprs_active.py: using RAC 29 04:37:19.731823 tst cs_paging_gprs_active.py: using CellId 26039 04:37:19.847880 tst cs_paging_gprs_active.py: using BVCI 26040 04:37:19.957080 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:19.967703 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:19.978230 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:19.988832 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:19.999524 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:20.010161 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:20.020995 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:20.031628 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:20.042469 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:20.158986 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:20.275059 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:37:20.475252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:37:20.773169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27000): Launched 04:37:21.031705 run iperf3-srv_10.42.42.10(pid=27001): Launched 04:37:21.142597 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:37:21.340804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:37:21.638332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27002): Launched 04:37:21.896315 run iperf3-srv_10.42.42.10(pid=27003): Launched 04:37:22.007415 tst cs_paging_gprs_active.py:38: start network... 04:37:22.205749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:22.664697 run create_hlr_db(pid=27004): Launched 04:37:22.777827 bus /sierra_2: Setting Powered False 04:37:23.837346 run create_hlr_db(pid=27004): Terminated: ok {rc=0} 04:37:24.268506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27006): Launched 04:37:24.584400 run osmo-hlr_10.42.42.2(pid=27007): Launched 04:37:24.704446 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:25.252918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27009): Launched 04:37:25.568169 run osmo-stp_10.42.42.5(pid=27010): Launched 04:37:25.689465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:37:26.234229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27012): Launched 04:37:26.354537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:37:26.622239 run patchelf(pid=27013): Launched 04:37:26.797845 run osmo-stp_10.42.42.5(pid=27010): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27010)] 04:37:26.931586 run osmo-stp_10.42.42.5(pid=27010): stdout: | (launched: 2022-12-10_04:37:25.510539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:27.067167 run osmo-stp_10.42.42.5(pid=27010): stderr: | 20221210043725702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043725702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043725702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043725702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043725703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043725703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043725703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:27.202822 run osmo-stp_10.42.42.5(pid=27010): stdout: | (launched: 2022-12-10_04:37:25.510539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:27.332122 run osmo-stp_10.42.42.5(pid=27010): stderr: | 20221210043725702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043725702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043725702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043725702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043725703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043725703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043725703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:27.486141 run patchelf(pid=27013): Terminating (SIGINT) 04:37:27.663546 run patchelf(pid=27013): Terminated: ok {rc=0} 04:37:27.791372 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27010): Process ended prematurely: osmo-stp_10.42.42.5(pid=27010) [trial-2369↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27010)] [trial-2369↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 04:37:27.801571 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 04:37:27.829814 run osmo-hlr_10.42.42.2(pid=27007): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27007)] 04:37:27.878588 run osmo-hlr_10.42.42.2(pid=27007): stdout: | (launched: 2022-12-10_04:37:24.526879) 04:37:27.929194 run osmo-hlr_10.42.42.2(pid=27007): stderr: | 20221210043724726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043724726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043724726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043724726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043724727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043724727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043724739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043724747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043724748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043724748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:27.980247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27000): Terminating (SIGTERM) 04:37:28.021305 run iperf3-srv_10.42.42.10(pid=27001): Terminating (SIGTERM) 04:37:28.062340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27002): Terminating (SIGTERM) 04:37:28.103318 run iperf3-srv_10.42.42.10(pid=27003): Terminating (SIGTERM) 04:37:28.144148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27006): Terminating (SIGTERM) 04:37:28.185325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27009): Terminating (SIGTERM) 04:37:28.226246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27012): Terminating (SIGTERM) 04:37:28.267544 --- ParallelTerminationStrategy: PID 27000 died... 04:37:28.287261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27000): Terminated: ok {rc=0} 04:37:28.332884 --- ParallelTerminationStrategy: PID 27001 died... 04:37:28.352210 run iperf3-srv_10.42.42.10(pid=27001): Terminated {rc=256} 04:37:28.397446 --- ParallelTerminationStrategy: PID 27002 died... 04:37:28.416644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27002): Terminated: ok {rc=0} 04:37:28.462007 --- ParallelTerminationStrategy: PID 27003 died... 04:37:28.481535 run iperf3-srv_10.42.42.10(pid=27003): Terminated {rc=256} 04:37:28.526821 --- ParallelTerminationStrategy: PID 27006 died... 04:37:28.546185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27006): Terminated: ok {rc=0} 04:37:28.591372 --- ParallelTerminationStrategy: PID 27009 died... 04:37:28.610615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27009): Terminated: ok {rc=0} 04:37:28.655533 --- ParallelTerminationStrategy: PID 27012 died... 04:37:28.674733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27012): Terminated: ok {rc=0} 04:37:28.760404 bus /gobi_0: Setting Powered False 04:37:29.856734 bus /gobi_0: Setting Powered False 04:37:30.983402 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 04:37:32.168532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.184201 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:37:32.227736 tst iperf3.py: using LAC 26040 04:37:32.352831 tst iperf3.py: using RAC 30 04:37:32.477037 tst iperf3.py: using CellId 26040 04:37:32.601204 tst iperf3.py: using BVCI 26041 04:37:32.715862 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.727306 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.738573 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.750101 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.762216 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.773486 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.785280 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.796399 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:32.807746 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:32.923348 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:37:33.123404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:37:33.419616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27014): Launched 04:37:33.677740 run iperf3-srv_10.42.42.10(pid=27015): Launched 04:37:33.788703 tst iperf3.py:8: start network... 04:37:33.987809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:34.445742 run create_hlr_db(pid=27016): Launched 04:37:34.558803 bus /gobi_6: Setting Powered False 04:37:35.618175 run create_hlr_db(pid=27016): Terminated: ok {rc=0} 04:37:36.030902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27019): Launched 04:37:36.324016 run osmo-hlr_10.42.42.2(pid=27020): Launched 04:37:36.435770 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:36.950498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27022): Launched 04:37:37.242480 run osmo-stp_10.42.42.5(pid=27023): Launched 04:37:37.353834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:37:37.859607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27025): Launched 04:37:37.971995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:37:38.220010 run patchelf(pid=27026): Launched 04:37:38.383466 run osmo-stp_10.42.42.5(pid=27023): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27023)] 04:37:38.508278 run osmo-stp_10.42.42.5(pid=27023): stdout: | (launched: 2022-12-10_04:37:37.188796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:38.634605 run osmo-stp_10.42.42.5(pid=27023): stderr: | 20221210043737357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043737357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043737358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043737358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043737359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043737359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043737359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:38.761205 run osmo-stp_10.42.42.5(pid=27023): stdout: | (launched: 2022-12-10_04:37:37.188796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:38.881711 run osmo-stp_10.42.42.5(pid=27023): stderr: | 20221210043737357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043737357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043737358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043737358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043737359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043737359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043737359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:39.025312 run patchelf(pid=27026): Terminating (SIGINT) 04:37:39.190675 run patchelf(pid=27026): Terminated: ok {rc=0} 04:37:39.310220 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27023): Process ended prematurely: osmo-stp_10.42.42.5(pid=27023) [trial-2369↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27023)] [trial-2369↪gprs:nanobts+band-1900↪iperf3.py:8] 04:37:39.319840 tst iperf3.py:8: Test FAILED (7.2 sec) 04:37:39.347042 run osmo-hlr_10.42.42.2(pid=27020): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27020)] 04:37:39.394160 run osmo-hlr_10.42.42.2(pid=27020): stdout: | (launched: 2022-12-10_04:37:36.270209) 04:37:39.442825 run osmo-hlr_10.42.42.2(pid=27020): stderr: | 20221210043736446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043736446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043736446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043736447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043736447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043736447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043736458 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043736466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043736466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043736466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:39.491745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27014): Terminating (SIGTERM) 04:37:39.531074 run iperf3-srv_10.42.42.10(pid=27015): Terminating (SIGTERM) 04:37:39.570352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27019): Terminating (SIGTERM) 04:37:39.609706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27022): Terminating (SIGTERM) 04:37:39.648847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27025): Terminating (SIGTERM) 04:37:39.688237 --- ParallelTerminationStrategy: PID 27014 died... 04:37:39.706832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27014): Terminated: ok {rc=0} 04:37:39.750698 --- ParallelTerminationStrategy: PID 27015 died... 04:37:39.768903 run iperf3-srv_10.42.42.10(pid=27015): Terminated {rc=256} 04:37:39.812939 --- ParallelTerminationStrategy: PID 27019 died... 04:37:39.831229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27019): Terminated: ok {rc=0} 04:37:39.874478 --- ParallelTerminationStrategy: PID 27022 died... 04:37:39.892720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27022): Terminated: ok {rc=0} 04:37:39.936121 --- ParallelTerminationStrategy: PID 27025 died... 04:37:39.955280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27025): Terminated: ok {rc=0} 04:37:40.039472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 04:37:41.183793 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.195014 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:37:41.233818 tst iperf3m4.py: using LAC 26041 04:37:41.350229 tst iperf3m4.py: using RAC 31 04:37:41.466331 tst iperf3m4.py: using CellId 26041 04:37:41.582874 tst iperf3m4.py: using BVCI 26042 04:37:41.690027 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.700787 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.711371 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.722256 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.733119 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.743927 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.754909 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.765743 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:37:41.776525 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:41.893244 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:42.011685 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:42.127903 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:42.240522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:37:42.438553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:37:42.735148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27027): Launched 04:37:42.990633 run iperf3-srv_10.42.42.10(pid=27028): Launched 04:37:43.101139 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:37:43.297384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:37:43.592414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27029): Launched 04:37:43.848522 run iperf3-srv_10.42.42.10(pid=27030): Launched 04:37:43.958491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:37:44.155065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:37:44.449977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27031): Launched 04:37:44.705447 run iperf3-srv_10.42.42.10(pid=27032): Launched 04:37:44.814971 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:37:45.011492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:37:45.306903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27033): Launched 04:37:45.563497 run iperf3-srv_10.42.42.10(pid=27034): Launched 04:37:45.673437 tst iperf3m4.py:8: start network... 04:37:45.877728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:46.354501 run create_hlr_db(pid=27035): Launched 04:37:46.502572 bus /gobi_6: Setting Powered False 04:37:47.561416 run create_hlr_db(pid=27035): Terminated: ok {rc=0} 04:37:47.989971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27037): Launched 04:37:48.303786 run osmo-hlr_10.42.42.2(pid=27038): Launched 04:37:48.423847 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:48.964096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27040): Launched 04:37:49.277592 run osmo-stp_10.42.42.5(pid=27041): Launched 04:37:49.396640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:37:49.936426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27043): Launched 04:37:50.055957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:37:50.319769 run patchelf(pid=27044): Launched 04:37:50.495702 run osmo-stp_10.42.42.5(pid=27041): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27041)] 04:37:50.628491 run osmo-stp_10.42.42.5(pid=27041): stdout: | (launched: 2022-12-10_04:37:49.220350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:50.762867 run osmo-stp_10.42.42.5(pid=27041): stderr: | 20221210043749409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043749409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043749410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043749410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043749410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043749410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043749411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:50.897473 run osmo-stp_10.42.42.5(pid=27041): stdout: | (launched: 2022-12-10_04:37:49.220350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:51.025866 run osmo-stp_10.42.42.5(pid=27041): stderr: | 20221210043749409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043749409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043749410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043749410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043749410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043749410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043749411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:51.178630 run patchelf(pid=27044): Terminating (SIGINT) 04:37:51.354704 run patchelf(pid=27044): Terminated: ok {rc=0} 04:37:51.481981 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27041): Process ended prematurely: osmo-stp_10.42.42.5(pid=27041) [trial-2369↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27041)] [trial-2369↪gprs:nanobts+band-1900↪iperf3m4.py:8] 04:37:51.492328 tst iperf3m4.py:8: Test FAILED (10.3 sec) 04:37:51.520810 run osmo-hlr_10.42.42.2(pid=27038): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27038)] 04:37:51.570047 run osmo-hlr_10.42.42.2(pid=27038): stdout: | (launched: 2022-12-10_04:37:48.246502) 04:37:51.620770 run osmo-hlr_10.42.42.2(pid=27038): stderr: | 20221210043748443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043748443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043748443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043748443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043748443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043748444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043748456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043748466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043748466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043748466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:51.671675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27027): Terminating (SIGTERM) 04:37:51.712730 run iperf3-srv_10.42.42.10(pid=27028): Terminating (SIGTERM) 04:37:51.753655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27029): Terminating (SIGTERM) 04:37:51.794634 run iperf3-srv_10.42.42.10(pid=27030): Terminating (SIGTERM) 04:37:51.835370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27031): Terminating (SIGTERM) 04:37:51.876576 run iperf3-srv_10.42.42.10(pid=27032): Terminating (SIGTERM) 04:37:51.917508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27033): Terminating (SIGTERM) 04:37:51.958993 run iperf3-srv_10.42.42.10(pid=27034): Terminating (SIGTERM) 04:37:52.000037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27037): Terminating (SIGTERM) 04:37:52.041195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27040): Terminating (SIGTERM) 04:37:52.082151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27043): Terminating (SIGTERM) 04:37:52.123446 --- ParallelTerminationStrategy: PID 27027 died... 04:37:52.143295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27027): Terminated: ok {rc=0} 04:37:52.189130 --- ParallelTerminationStrategy: PID 27028 died... 04:37:52.208530 run iperf3-srv_10.42.42.10(pid=27028): Terminated {rc=256} 04:37:52.253943 --- ParallelTerminationStrategy: PID 27029 died... 04:37:52.273316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27029): Terminated: ok {rc=0} 04:37:52.318825 --- ParallelTerminationStrategy: PID 27030 died... 04:37:52.338091 run iperf3-srv_10.42.42.10(pid=27030): Terminated {rc=256} 04:37:52.383354 --- ParallelTerminationStrategy: PID 27031 died... 04:37:52.402638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27031): Terminated: ok {rc=0} 04:37:52.448089 --- ParallelTerminationStrategy: PID 27032 died... 04:37:52.467350 run iperf3-srv_10.42.42.10(pid=27032): Terminated {rc=256} 04:37:52.512887 --- ParallelTerminationStrategy: PID 27033 died... 04:37:52.532720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27033): Terminated: ok {rc=0} 04:37:52.578092 --- ParallelTerminationStrategy: PID 27034 died... 04:37:52.597410 run iperf3-srv_10.42.42.10(pid=27034): Terminated {rc=256} 04:37:52.642788 --- ParallelTerminationStrategy: PID 27037 died... 04:37:52.662066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27037): Terminated: ok {rc=0} 04:37:52.707451 --- ParallelTerminationStrategy: PID 27040 died... 04:37:52.726748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27040): Terminated: ok {rc=0} 04:37:52.771928 --- ParallelTerminationStrategy: PID 27043 died... 04:37:52.791247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27043): Terminated: ok {rc=0} 04:37:52.876291 bus /gobi_4: Setting Powered False 04:37:53.975187 bus /gobi_4: Setting Powered False 04:37:55.087669 bus /gobi_1: Setting Powered False 04:37:56.186045 bus /gobi_1: Setting Powered False 04:37:57.299593 bus /gobi_0: Setting Powered False 04:37:58.396440 bus /gobi_0: Setting Powered False 04:37:59.508700 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 04:38:00.606716 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:00.617986 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:00.664082 tst ping.py: using LAC 26042 04:38:00.776854 tst ping.py: using RAC 32 04:38:00.918348 tst ping.py: using CellId 26042 04:38:01.056185 tst ping.py: using BVCI 26043 04:38:01.165429 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:01.176409 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:01.187655 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:01.201681 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:01.213206 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:01.225586 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:01.239505 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:01.252118 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:01.368111 tst ping.py:19: start network... 04:38:01.612619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:02.105457 run create_hlr_db(pid=27045): Launched 04:38:02.261901 bus /gobi_6: Setting Powered False 04:38:03.323768 run create_hlr_db(pid=27045): Terminated: ok {rc=0} 04:38:03.735511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Launched 04:38:04.025613 run osmo-hlr_10.42.42.2(pid=27049): Launched 04:38:04.135110 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:04.650334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27051): Launched 04:38:04.938501 run osmo-stp_10.42.42.5(pid=27052): Launched 04:38:05.047716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:05.545413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27054): Launched 04:38:05.656047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:05.899294 run patchelf(pid=27055): Launched 04:38:06.059036 run osmo-stp_10.42.42.5(pid=27052): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27052)] 04:38:06.181461 run osmo-stp_10.42.42.5(pid=27052): stdout: | (launched: 2022-12-10_04:38:04.885411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:06.305371 run osmo-stp_10.42.42.5(pid=27052): stderr: | 20221210043805054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043805054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043805055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043805055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043805055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043805056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043805056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:06.429357 run osmo-stp_10.42.42.5(pid=27052): stdout: | (launched: 2022-12-10_04:38:04.885411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:06.547403 run osmo-stp_10.42.42.5(pid=27052): stderr: | 20221210043805054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043805054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043805055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043805055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043805055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043805056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043805056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:06.687379 run patchelf(pid=27055): Terminating (SIGINT) 04:38:06.849537 run patchelf(pid=27055): Terminated: ok {rc=0} 04:38:06.966370 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27052): Process ended prematurely: osmo-stp_10.42.42.5(pid=27052) [trial-2369↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27052)] [trial-2369↪gprs:nanobts+band-1900↪ping.py:22] 04:38:06.975346 tst ping.py:22: Test FAILED (6.4 sec) 04:38:07.002102 run osmo-hlr_10.42.42.2(pid=27049): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27049)] 04:38:07.048871 run osmo-hlr_10.42.42.2(pid=27049): stdout: | (launched: 2022-12-10_04:38:03.973137) 04:38:07.097316 run osmo-hlr_10.42.42.2(pid=27049): stderr: | 20221210043804148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043804148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043804148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043804148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043804148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043804148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043804160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043804170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043804170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043804170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:07.146245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Terminating (SIGTERM) 04:38:07.185459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27051): Terminating (SIGTERM) 04:38:07.225106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27054): Terminating (SIGTERM) 04:38:07.264488 --- ParallelTerminationStrategy: PID 27047 died... 04:38:07.283265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Terminated: ok {rc=0} 04:38:07.327231 --- ParallelTerminationStrategy: PID 27051 died... 04:38:07.345649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27051): Terminated: ok {rc=0} 04:38:07.389320 --- ParallelTerminationStrategy: PID 27054 died... 04:38:07.407631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27054): Terminated: ok {rc=0} 04:38:07.492308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 04:38:08.579786 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:08.591519 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:08.631429 tst ping_idle_ping.py: using LAC 26043 04:38:08.745359 tst ping_idle_ping.py: using RAC 33 04:38:08.859165 tst ping_idle_ping.py: using CellId 26043 04:38:08.981297 tst ping_idle_ping.py: using BVCI 26044 04:38:09.094760 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:09.106168 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:09.117517 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:09.129465 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:09.141167 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:09.152781 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:09.164578 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:09.176450 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:09.293100 tst ping_idle_ping.py:24: start network... 04:38:09.502101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:09.982283 run create_hlr_db(pid=27056): Launched 04:38:10.107975 bus /gobi_6: Setting Powered False 04:38:11.170531 run create_hlr_db(pid=27056): Terminated: ok {rc=0} 04:38:11.585528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Launched 04:38:11.895615 run osmo-hlr_10.42.42.2(pid=27059): Launched 04:38:12.012503 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:12.545116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Launched 04:38:12.854612 run osmo-stp_10.42.42.5(pid=27062): Launched 04:38:12.972011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:13.506827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Launched 04:38:13.625033 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:13.886239 run patchelf(pid=27065): Launched 04:38:14.057978 run osmo-stp_10.42.42.5(pid=27062): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] 04:38:14.189390 run osmo-stp_10.42.42.5(pid=27062): stdout: | (launched: 2022-12-10_04:38:12.798142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:14.321997 run osmo-stp_10.42.42.5(pid=27062): stderr: | 20221210043812990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043812990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043812990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043812991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043812991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043812991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043812991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:14.454790 run osmo-stp_10.42.42.5(pid=27062): stdout: | (launched: 2022-12-10_04:38:12.798142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:14.582670 run osmo-stp_10.42.42.5(pid=27062): stderr: | 20221210043812990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043812990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043812990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043812991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043812991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043812991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043812991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:14.733066 run patchelf(pid=27065): Terminating (SIGINT) 04:38:14.905998 run patchelf(pid=27065): Terminated: ok {rc=0} 04:38:15.030883 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27062): Process ended prematurely: osmo-stp_10.42.42.5(pid=27062) [trial-2369↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] [trial-2369↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 04:38:15.040509 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:38:15.068621 run osmo-hlr_10.42.42.2(pid=27059): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27059)] 04:38:15.117859 run osmo-hlr_10.42.42.2(pid=27059): stdout: | (launched: 2022-12-10_04:38:11.839118) 04:38:15.168849 run osmo-hlr_10.42.42.2(pid=27059): stderr: | 20221210043812037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043812037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043812037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043812037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043812037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043812037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043812050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043812059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043812059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043812059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:15.220232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Terminating (SIGTERM) 04:38:15.261680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Terminating (SIGTERM) 04:38:15.303520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Terminating (SIGTERM) 04:38:15.345127 --- ParallelTerminationStrategy: PID 27058 died... 04:38:15.365049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27058): Terminated: ok {rc=0} 04:38:15.411007 --- ParallelTerminationStrategy: PID 27061 died... 04:38:15.430591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27061): Terminated: ok {rc=0} 04:38:15.476327 --- ParallelTerminationStrategy: PID 27064 died... 04:38:15.496163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27064): Terminated: ok {rc=0} 04:38:15.581515 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 04:38:16.927354 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:38:16.934343 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:38:16.959576 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:38:16.999494 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:38:17.094855 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:38:17.126948 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:38:17.186700 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:38:17.821565 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:38:17.884857 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:17.900859 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:38:17.947059 tst cs_paging_gprs_active.py: using LAC 26044 04:38:18.093670 tst cs_paging_gprs_active.py: using RAC 34 04:38:18.239002 tst cs_paging_gprs_active.py: using CellId 26044 04:38:18.395142 tst cs_paging_gprs_active.py: using BVCI 26045 04:38:18.527208 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.540784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.557872 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.572086 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.586654 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.599670 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.612119 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.623792 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:18.640569 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:38:18.777385 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:38:18.932410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:38:19.175191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:19.505711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27338): Launched 04:38:19.787139 run iperf3-srv_10.42.42.10(pid=27339): Launched 04:38:19.901297 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:38:20.105665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:20.417457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27340): Launched 04:38:20.705654 run iperf3-srv_10.42.42.10(pid=27341): Launched 04:38:20.830610 tst cs_paging_gprs_active.py:38: start network... 04:38:21.044771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:21.545053 run create_hlr_db(pid=27344): Launched 04:38:21.700449 bus /gobi_6: Setting Powered False 04:38:22.761687 run create_hlr_db(pid=27344): Terminated: ok {rc=0} 04:38:23.197932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27346): Launched 04:38:23.514229 run osmo-hlr_10.42.42.2(pid=27347): Launched 04:38:23.748860 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:24.472386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27349): Launched 04:38:24.805177 run osmo-stp_10.42.42.5(pid=27350): Launched 04:38:25.046617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:25.754498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27352): Launched 04:38:25.887763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:26.161775 run patchelf(pid=27353): Launched 04:38:26.351302 run osmo-stp_10.42.42.5(pid=27350): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27350)] 04:38:26.485920 run osmo-stp_10.42.42.5(pid=27350): stdout: | (launched: 2022-12-10_04:38:24.740843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:26.625332 run osmo-stp_10.42.42.5(pid=27350): stderr: | 20221210043825081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043825081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043825081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043825082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043825082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043825082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043825082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:26.761936 run osmo-stp_10.42.42.5(pid=27350): stdout: | (launched: 2022-12-10_04:38:24.740843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:26.891546 run osmo-stp_10.42.42.5(pid=27350): stderr: | 20221210043825081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043825081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043825081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043825082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043825082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043825082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043825082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:27.045097 run patchelf(pid=27353): Terminating (SIGINT) 04:38:27.225920 run patchelf(pid=27353): Terminated: ok {rc=0} 04:38:27.353824 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27350): Process ended prematurely: osmo-stp_10.42.42.5(pid=27350) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27350)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:38:27.365951 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 04:38:27.397579 run osmo-hlr_10.42.42.2(pid=27347): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27347)] 04:38:27.448131 run osmo-hlr_10.42.42.2(pid=27347): stdout: | (launched: 2022-12-10_04:38:23.455219) 04:38:27.501617 run osmo-hlr_10.42.42.2(pid=27347): stderr: | 20221210043823795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043823795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043823795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043823795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043823796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043823796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043823816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043823828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043823828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043823828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:27.554758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27338): Terminating (SIGTERM) 04:38:27.600054 run iperf3-srv_10.42.42.10(pid=27339): Terminating (SIGTERM) 04:38:27.644059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27340): Terminating (SIGTERM) 04:38:27.687560 run iperf3-srv_10.42.42.10(pid=27341): Terminating (SIGTERM) 04:38:27.731693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27346): Terminating (SIGTERM) 04:38:27.776342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27349): Terminating (SIGTERM) 04:38:27.821408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27352): Terminating (SIGTERM) 04:38:27.866474 --- ParallelTerminationStrategy: PID 27338 died... 04:38:27.886557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27338): Terminated: ok {rc=0} 04:38:27.936046 --- ParallelTerminationStrategy: PID 27339 died... 04:38:27.956332 run iperf3-srv_10.42.42.10(pid=27339): Terminated {rc=256} 04:38:28.004789 --- ParallelTerminationStrategy: PID 27340 died... 04:38:28.024515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27340): Terminated: ok {rc=0} 04:38:28.073527 --- ParallelTerminationStrategy: PID 27341 died... 04:38:28.093332 run iperf3-srv_10.42.42.10(pid=27341): Terminated {rc=256} 04:38:28.141272 --- ParallelTerminationStrategy: PID 27346 died... 04:38:28.161974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27346): Terminated: ok {rc=0} 04:38:28.210824 --- ParallelTerminationStrategy: PID 27349 died... 04:38:28.230823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27349): Terminated: ok {rc=0} 04:38:28.278317 --- ParallelTerminationStrategy: PID 27352 died... 04:38:28.298500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27352): Terminated: ok {rc=0} 04:38:28.388577 bus /gobi_0: Setting Powered False 04:38:29.487392 bus /gobi_0: Setting Powered False 04:38:30.605180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:38:31.803783 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:31.818270 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:38:31.869110 tst iperf3.py: using LAC 26045 04:38:32.047638 tst iperf3.py: using RAC 35 04:38:32.210224 tst iperf3.py: using CellId 26045 04:38:32.343709 tst iperf3.py: using BVCI 26046 04:38:32.498485 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.512037 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.528038 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.543249 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.559080 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.575306 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.591053 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.609284 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:32.624506 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:38:32.760499 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:38:32.991153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:33.309416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27354): Launched 04:38:33.599641 run iperf3-srv_10.42.42.10(pid=27355): Launched 04:38:33.734244 tst iperf3.py:8: start network... 04:38:33.955647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:34.466374 run create_hlr_db(pid=27356): Launched 04:38:34.629718 bus /gobi_6: Setting Powered False 04:38:35.695489 run create_hlr_db(pid=27356): Terminated: ok {rc=0} 04:38:36.157949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27358): Launched 04:38:36.503172 run osmo-hlr_10.42.42.2(pid=27359): Launched 04:38:36.748222 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:37.429294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27361): Launched 04:38:37.779792 run osmo-stp_10.42.42.5(pid=27362): Launched 04:38:38.029020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:38.686191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27364): Launched 04:38:38.824309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:39.107737 run patchelf(pid=27365): Launched 04:38:39.304422 run osmo-stp_10.42.42.5(pid=27362): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27362)] 04:38:39.448906 run osmo-stp_10.42.42.5(pid=27362): stdout: | (launched: 2022-12-10_04:38:37.713996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:39.590178 run osmo-stp_10.42.42.5(pid=27362): stderr: | 20221210043838021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043838021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043838021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043838022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043838022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043838022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043838022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:39.728104 run osmo-stp_10.42.42.5(pid=27362): stdout: | (launched: 2022-12-10_04:38:37.713996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:39.859542 run osmo-stp_10.42.42.5(pid=27362): stderr: | 20221210043838021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043838021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043838021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043838022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043838022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043838022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043838022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:40.015528 run patchelf(pid=27365): Terminating (SIGINT) 04:38:40.195557 run patchelf(pid=27365): Terminated: ok {rc=0} 04:38:40.325659 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27362): Process ended prematurely: osmo-stp_10.42.42.5(pid=27362) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27362)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 04:38:40.336209 tst iperf3.py:8: Test FAILED (8.6 sec) 04:38:40.365330 run osmo-hlr_10.42.42.2(pid=27359): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27359)] 04:38:40.415397 run osmo-hlr_10.42.42.2(pid=27359): stdout: | (launched: 2022-12-10_04:38:36.440459) 04:38:40.467261 run osmo-hlr_10.42.42.2(pid=27359): stderr: | 20221210043836752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043836752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043836752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043836752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043836752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043836752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043836768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043836785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043836786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043836786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:40.520065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27354): Terminating (SIGTERM) 04:38:40.562272 run iperf3-srv_10.42.42.10(pid=27355): Terminating (SIGTERM) 04:38:40.603983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27358): Terminating (SIGTERM) 04:38:40.645592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27361): Terminating (SIGTERM) 04:38:40.686962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27364): Terminating (SIGTERM) 04:38:40.729155 --- ParallelTerminationStrategy: PID 27354 died... 04:38:40.749410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27354): Terminated: ok {rc=0} 04:38:40.795876 --- ParallelTerminationStrategy: PID 27355 died... 04:38:40.815485 run iperf3-srv_10.42.42.10(pid=27355): Terminated {rc=256} 04:38:40.861134 --- ParallelTerminationStrategy: PID 27358 died... 04:38:40.880412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27358): Terminated: ok {rc=0} 04:38:40.926185 --- ParallelTerminationStrategy: PID 27361 died... 04:38:40.945724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27361): Terminated: ok {rc=0} 04:38:40.991482 --- ParallelTerminationStrategy: PID 27364 died... 04:38:41.011208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27364): Terminated: ok {rc=0} 04:38:41.097959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:38:42.242812 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.254457 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:38:42.296128 tst iperf3m4.py: using LAC 26046 04:38:42.414987 tst iperf3m4.py: using RAC 36 04:38:42.535161 tst iperf3m4.py: using CellId 26046 04:38:42.659479 tst iperf3m4.py: using BVCI 26047 04:38:42.769689 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.780759 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.791691 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.802810 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.814001 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.825141 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.836307 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.847344 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:38:42.858468 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:38:42.971990 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:38:43.093439 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:38:43.210721 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:38:43.329501 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:38:43.548845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:43.872876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27366): Launched 04:38:44.153691 run iperf3-srv_10.42.42.10(pid=27367): Launched 04:38:44.274403 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:38:44.492505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:44.817610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27368): Launched 04:38:45.097703 run iperf3-srv_10.42.42.10(pid=27369): Launched 04:38:45.217907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:38:45.435292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:45.759433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27370): Launched 04:38:46.077702 run iperf3-srv_10.42.42.10(pid=27371): Launched 04:38:46.201114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:38:46.423417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:46.755266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27372): Launched 04:38:47.052198 run iperf3-srv_10.42.42.10(pid=27373): Launched 04:38:47.187299 tst iperf3m4.py:8: start network... 04:38:47.404443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:47.905437 run create_hlr_db(pid=27374): Launched 04:38:48.035226 bus /gobi_6: Setting Powered False 04:38:49.099221 run create_hlr_db(pid=27374): Terminated: ok {rc=0} 04:38:49.531527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Launched 04:38:49.835048 run osmo-hlr_10.42.42.2(pid=27377): Launched 04:38:49.950143 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:50.488122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Launched 04:38:50.790516 run osmo-stp_10.42.42.5(pid=27380): Launched 04:38:50.905841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:51.427154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27382): Launched 04:38:51.542677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:51.799580 run patchelf(pid=27383): Launched 04:38:51.967502 run osmo-stp_10.42.42.5(pid=27380): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] 04:38:52.095736 run osmo-stp_10.42.42.5(pid=27380): stdout: | (launched: 2022-12-10_04:38:50.734924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:52.226457 run osmo-stp_10.42.42.5(pid=27380): stderr: | 20221210043850905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043850905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043850905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043850906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043850906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043850906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043850906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:52.356587 run osmo-stp_10.42.42.5(pid=27380): stdout: | (launched: 2022-12-10_04:38:50.734924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:52.481124 run osmo-stp_10.42.42.5(pid=27380): stderr: | 20221210043850905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043850905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043850905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043850906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043850906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043850906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043850906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:52.627592 run patchelf(pid=27383): Terminating (SIGINT) 04:38:52.797838 run patchelf(pid=27383): Terminated: ok {rc=0} 04:38:52.921150 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27380): Process ended prematurely: osmo-stp_10.42.42.5(pid=27380) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 04:38:52.930868 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:38:52.958875 run osmo-hlr_10.42.42.2(pid=27377): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27377)] 04:38:53.006241 run osmo-hlr_10.42.42.2(pid=27377): stdout: | (launched: 2022-12-10_04:38:49.779321) 04:38:53.055537 run osmo-hlr_10.42.42.2(pid=27377): stderr: | 20221210043849955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043849955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043849955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043849955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043849955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043849955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043849967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043849976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043849976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043849976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:53.105404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27366): Terminating (SIGTERM) 04:38:53.145217 run iperf3-srv_10.42.42.10(pid=27367): Terminating (SIGTERM) 04:38:53.184937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27368): Terminating (SIGTERM) 04:38:53.224581 run iperf3-srv_10.42.42.10(pid=27369): Terminating (SIGTERM) 04:38:53.264238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27370): Terminating (SIGTERM) 04:38:53.303706 run iperf3-srv_10.42.42.10(pid=27371): Terminating (SIGTERM) 04:38:53.343092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27372): Terminating (SIGTERM) 04:38:53.382679 run iperf3-srv_10.42.42.10(pid=27373): Terminating (SIGTERM) 04:38:53.422178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Terminating (SIGTERM) 04:38:53.461788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Terminating (SIGTERM) 04:38:53.501772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27382): Terminating (SIGTERM) 04:38:53.541712 --- ParallelTerminationStrategy: PID 27366 died... 04:38:53.560881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27366): Terminated: ok {rc=0} 04:38:53.605140 --- ParallelTerminationStrategy: PID 27367 died... 04:38:53.623657 run iperf3-srv_10.42.42.10(pid=27367): Terminated {rc=256} 04:38:53.667408 --- ParallelTerminationStrategy: PID 27368 died... 04:38:53.686095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27368): Terminated: ok {rc=0} 04:38:53.729563 --- ParallelTerminationStrategy: PID 27369 died... 04:38:53.747911 run iperf3-srv_10.42.42.10(pid=27369): Terminated {rc=256} 04:38:53.791587 --- ParallelTerminationStrategy: PID 27370 died... 04:38:53.810066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27370): Terminated: ok {rc=0} 04:38:53.854216 --- ParallelTerminationStrategy: PID 27371 died... 04:38:53.872555 run iperf3-srv_10.42.42.10(pid=27371): Terminated {rc=256} 04:38:53.916297 --- ParallelTerminationStrategy: PID 27372 died... 04:38:53.935073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27372): Terminated: ok {rc=0} 04:38:53.978794 --- ParallelTerminationStrategy: PID 27373 died... 04:38:53.997228 run iperf3-srv_10.42.42.10(pid=27373): Terminated {rc=256} 04:38:54.040838 --- ParallelTerminationStrategy: PID 27376 died... 04:38:54.059675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Terminated: ok {rc=0} 04:38:54.103559 --- ParallelTerminationStrategy: PID 27379 died... 04:38:54.122026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Terminated: ok {rc=0} 04:38:54.165901 --- ParallelTerminationStrategy: PID 27382 died... 04:38:54.184474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27382): Terminated: ok {rc=0} 04:38:54.269712 bus /gobi_4: Setting Powered False 04:38:55.368242 bus /gobi_4: Setting Powered False 04:38:56.482958 bus /gobi_1: Setting Powered False 04:38:57.580888 bus /gobi_1: Setting Powered False 04:38:58.692050 bus /gobi_0: Setting Powered False 04:38:59.788272 bus /gobi_0: Setting Powered False 04:39:00.918855 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 04:39:02.019618 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.032549 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:02.077378 tst ping.py: using LAC 26047 04:39:02.197302 tst ping.py: using RAC 37 04:39:02.324032 tst ping.py: using CellId 26047 04:39:02.451279 tst ping.py: using BVCI 26048 04:39:02.561145 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.573219 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.584124 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.595794 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.607521 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.619132 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.631030 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:02.642721 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:02.756856 tst ping.py:19: start network... 04:39:02.955457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:03.412913 run create_hlr_db(pid=27384): Launched 04:39:03.524410 bus /gobi_6: Setting Powered False 04:39:04.582706 run create_hlr_db(pid=27384): Terminated: ok {rc=0} 04:39:04.995254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27386): Launched 04:39:05.290399 run osmo-hlr_10.42.42.2(pid=27387): Launched 04:39:05.402838 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:05.925444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27389): Launched 04:39:06.221435 run osmo-stp_10.42.42.5(pid=27390): Launched 04:39:06.334360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:06.845591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27392): Launched 04:39:06.959129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:07.209708 run patchelf(pid=27393): Launched 04:39:07.373977 run osmo-stp_10.42.42.5(pid=27390): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27390)] 04:39:07.499831 run osmo-stp_10.42.42.5(pid=27390): stdout: | (launched: 2022-12-10_04:39:06.166590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:07.626872 run osmo-stp_10.42.42.5(pid=27390): stderr: | 20221210043906335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043906335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043906335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043906336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043906336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043906336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043906336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:07.754285 run osmo-stp_10.42.42.5(pid=27390): stdout: | (launched: 2022-12-10_04:39:06.166590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:07.875791 run osmo-stp_10.42.42.5(pid=27390): stderr: | 20221210043906335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043906335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043906335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043906336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043906336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043906336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043906336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:08.019201 run patchelf(pid=27393): Terminating (SIGINT) 04:39:08.185477 run patchelf(pid=27393): Terminated: ok {rc=0} 04:39:08.305606 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27390): Process ended prematurely: osmo-stp_10.42.42.5(pid=27390) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27390)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 04:39:08.314669 tst ping.py:22: Test FAILED (6.3 sec) 04:39:08.341874 run osmo-hlr_10.42.42.2(pid=27387): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27387)] 04:39:08.389451 run osmo-hlr_10.42.42.2(pid=27387): stdout: | (launched: 2022-12-10_04:39:05.235449) 04:39:08.438466 run osmo-hlr_10.42.42.2(pid=27387): stderr: | 20221210043905412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043905412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043905412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043905412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043905412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043905412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043905424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043905432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043905433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043905433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:08.488064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27386): Terminating (SIGTERM) 04:39:08.527475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27389): Terminating (SIGTERM) 04:39:08.567036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27392): Terminating (SIGTERM) 04:39:08.606763 --- ParallelTerminationStrategy: PID 27386 died... 04:39:08.625728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27386): Terminated: ok {rc=0} 04:39:08.669921 --- ParallelTerminationStrategy: PID 27389 died... 04:39:08.688315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27389): Terminated: ok {rc=0} 04:39:08.732274 --- ParallelTerminationStrategy: PID 27392 died... 04:39:08.750818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27392): Terminated: ok {rc=0} 04:39:08.833681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:39:09.920873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:09.933259 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:09.977131 tst ping_idle_ping.py: using LAC 26048 04:39:10.103346 tst ping_idle_ping.py: using RAC 38 04:39:10.229739 tst ping_idle_ping.py: using CellId 26048 04:39:10.355869 tst ping_idle_ping.py: using BVCI 26049 04:39:10.472561 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:10.484178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:10.495487 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:10.507348 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:10.519395 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:10.531202 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:10.543162 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:10.554984 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:10.672797 tst ping_idle_ping.py:24: start network... 04:39:10.885676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:11.382073 run create_hlr_db(pid=27394): Launched 04:39:11.510315 bus /gobi_6: Setting Powered False 04:39:12.574230 run create_hlr_db(pid=27394): Terminated: ok {rc=0} 04:39:13.000293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27396): Launched 04:39:13.297665 run osmo-hlr_10.42.42.2(pid=27397): Launched 04:39:13.411507 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:13.940053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27399): Launched 04:39:14.235754 run osmo-stp_10.42.42.5(pid=27400): Launched 04:39:14.348473 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:14.859876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27402): Launched 04:39:14.972650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:15.222974 run patchelf(pid=27403): Launched 04:39:15.387611 run osmo-stp_10.42.42.5(pid=27400): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27400)] 04:39:15.513631 run osmo-stp_10.42.42.5(pid=27400): stdout: | (launched: 2022-12-10_04:39:14.181241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:15.641199 run osmo-stp_10.42.42.5(pid=27400): stderr: | 20221210043914350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043914350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043914350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043914350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043914351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043914351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043914351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:15.768743 run osmo-stp_10.42.42.5(pid=27400): stdout: | (launched: 2022-12-10_04:39:14.181241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:15.914935 run osmo-stp_10.42.42.5(pid=27400): stderr: | 20221210043914350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043914350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043914350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043914350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043914351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043914351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043914351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:16.070346 run patchelf(pid=27403): Terminating (SIGINT) 04:39:16.243082 run patchelf(pid=27403): Terminated: ok {rc=0} 04:39:16.368516 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27400): Process ended prematurely: osmo-stp_10.42.42.5(pid=27400) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27400)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 04:39:16.378919 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:39:16.409833 run osmo-hlr_10.42.42.2(pid=27397): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27397)] 04:39:16.459863 run osmo-hlr_10.42.42.2(pid=27397): stdout: | (launched: 2022-12-10_04:39:13.242612) 04:39:16.511547 run osmo-hlr_10.42.42.2(pid=27397): stderr: | 20221210043913416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043913416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043913416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043913416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043913416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043913416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043913429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043913437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043913437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043913438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:16.564322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27396): Terminating (SIGTERM) 04:39:16.607008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27399): Terminating (SIGTERM) 04:39:16.649782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27402): Terminating (SIGTERM) 04:39:16.692733 --- ParallelTerminationStrategy: PID 27396 died... 04:39:16.712884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27396): Terminated: ok {rc=0} 04:39:16.760642 --- ParallelTerminationStrategy: PID 27399 died... 04:39:16.780550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27399): Terminated: ok {rc=0} 04:39:16.828095 --- ParallelTerminationStrategy: PID 27402 died... 04:39:16.847562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27402): Terminated: ok {rc=0} 04:39:16.935426 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:39:18.228807 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:39:18.236065 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:39:18.263337 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:39:18.303958 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:39:18.393209 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:39:18.417403 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:39:18.456429 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:39:19.055392 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:39:19.107295 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.118947 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:39:19.179964 tst cs_paging_gprs_active.py: using LAC 26049 04:39:19.300326 tst cs_paging_gprs_active.py: using RAC 39 04:39:19.420120 tst cs_paging_gprs_active.py: using CellId 26049 04:39:19.538935 tst cs_paging_gprs_active.py: using BVCI 26050 04:39:19.648566 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.659782 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.670627 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.682211 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.693566 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.705092 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.717357 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.728169 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:19.739761 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:39:19.859445 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:39:19.976461 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:39:20.194529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:20.518008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27409): Launched 04:39:20.797780 run iperf3-srv_10.42.42.10(pid=27410): Launched 04:39:20.917754 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:39:21.135003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:21.457690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27411): Launched 04:39:21.737197 run iperf3-srv_10.42.42.10(pid=27412): Launched 04:39:21.857733 tst cs_paging_gprs_active.py:38: start network... 04:39:22.074552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:22.571472 run create_hlr_db(pid=27413): Launched 04:39:22.702317 bus /gobi_6: Setting Powered False 04:39:23.766158 run create_hlr_db(pid=27413): Terminated: ok {rc=0} 04:39:24.198080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27415): Launched 04:39:24.499596 run osmo-hlr_10.42.42.2(pid=27416): Launched 04:39:24.616034 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:25.148741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27418): Launched 04:39:25.450411 run osmo-stp_10.42.42.5(pid=27419): Launched 04:39:25.566123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:26.087461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27421): Launched 04:39:26.203278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:26.459929 run patchelf(pid=27422): Launched 04:39:26.627902 run osmo-stp_10.42.42.5(pid=27419): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27419)] 04:39:26.755850 run osmo-stp_10.42.42.5(pid=27419): stdout: | (launched: 2022-12-10_04:39:25.394834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:26.885918 run osmo-stp_10.42.42.5(pid=27419): stderr: | 20221210043925565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043925565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043925565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043925566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043925566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043925566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043925566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:27.016197 run osmo-stp_10.42.42.5(pid=27419): stdout: | (launched: 2022-12-10_04:39:25.394834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:27.140024 run osmo-stp_10.42.42.5(pid=27419): stderr: | 20221210043925565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043925565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043925565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043925566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043925566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043925566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043925566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:27.286977 run patchelf(pid=27422): Terminating (SIGINT) 04:39:27.456689 run patchelf(pid=27422): Terminated: ok {rc=0} 04:39:27.579409 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27419): Process ended prematurely: osmo-stp_10.42.42.5(pid=27419) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27419)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:39:27.589229 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:39:27.617306 run osmo-hlr_10.42.42.2(pid=27416): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27416)] 04:39:27.664686 run osmo-hlr_10.42.42.2(pid=27416): stdout: | (launched: 2022-12-10_04:39:24.443988) 04:39:27.713859 run osmo-hlr_10.42.42.2(pid=27416): stderr: | 20221210043924622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043924622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043924622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043924622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043924622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043924622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043924634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043924643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043924643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043924643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:27.763711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27409): Terminating (SIGTERM) 04:39:27.803917 run iperf3-srv_10.42.42.10(pid=27410): Terminating (SIGTERM) 04:39:27.843984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27411): Terminating (SIGTERM) 04:39:27.884282 run iperf3-srv_10.42.42.10(pid=27412): Terminating (SIGTERM) 04:39:27.924308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27415): Terminating (SIGTERM) 04:39:27.964520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27418): Terminating (SIGTERM) 04:39:28.004539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27421): Terminating (SIGTERM) 04:39:28.044844 --- ParallelTerminationStrategy: PID 27409 died... 04:39:28.064155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27409): Terminated: ok {rc=0} 04:39:28.108702 --- ParallelTerminationStrategy: PID 27410 died... 04:39:28.127465 run iperf3-srv_10.42.42.10(pid=27410): Terminated {rc=256} 04:39:28.171555 --- ParallelTerminationStrategy: PID 27411 died... 04:39:28.190289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27411): Terminated: ok {rc=0} 04:39:28.234425 --- ParallelTerminationStrategy: PID 27412 died... 04:39:28.253123 run iperf3-srv_10.42.42.10(pid=27412): Terminated {rc=256} 04:39:28.297391 --- ParallelTerminationStrategy: PID 27415 died... 04:39:28.316114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27415): Terminated: ok {rc=0} 04:39:28.360140 --- ParallelTerminationStrategy: PID 27418 died... 04:39:28.378969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27418): Terminated: ok {rc=0} 04:39:28.423059 --- ParallelTerminationStrategy: PID 27421 died... 04:39:28.441805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27421): Terminated: ok {rc=0} 04:39:28.527773 bus /gobi_0: Setting Powered False 04:39:29.630920 bus /gobi_0: Setting Powered False 04:39:30.746197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:39:31.915187 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:31.931469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:39:32.011270 tst iperf3.py: using LAC 26050 04:39:32.139981 tst iperf3.py: using RAC 40 04:39:32.274432 tst iperf3.py: using CellId 26050 04:39:32.399699 tst iperf3.py: using BVCI 26051 04:39:32.515506 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.527540 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.539033 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.550581 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.562122 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.574020 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.586334 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.598052 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:32.609847 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:39:32.725855 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:39:32.930153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:33.233635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27425): Launched 04:39:33.497029 run iperf3-srv_10.42.42.10(pid=27426): Launched 04:39:33.610919 tst iperf3.py:8: start network... 04:39:33.814169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:34.281441 run create_hlr_db(pid=27427): Launched 04:39:34.396593 bus /gobi_6: Setting Powered False 04:39:35.456924 run create_hlr_db(pid=27427): Terminated: ok {rc=0} 04:39:35.897364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27429): Launched 04:39:36.219490 run osmo-hlr_10.42.42.2(pid=27430): Launched 04:39:36.341940 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:36.896233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27432): Launched 04:39:37.217876 run osmo-stp_10.42.42.5(pid=27433): Launched 04:39:37.339299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:37.893575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27435): Launched 04:39:38.015978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:38.286914 run patchelf(pid=27436): Launched 04:39:38.464561 run osmo-stp_10.42.42.5(pid=27433): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27433)] 04:39:38.601240 run osmo-stp_10.42.42.5(pid=27433): stdout: | (launched: 2022-12-10_04:39:37.158525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:38.738889 run osmo-stp_10.42.42.5(pid=27433): stderr: | 20221210043937353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043937353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043937353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043937354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043937354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043937354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043937354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:38.876391 run osmo-stp_10.42.42.5(pid=27433): stdout: | (launched: 2022-12-10_04:39:37.158525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:39.008021 run osmo-stp_10.42.42.5(pid=27433): stderr: | 20221210043937353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043937353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043937353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043937354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043937354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043937354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043937354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:39.163930 run patchelf(pid=27436): Terminating (SIGINT) 04:39:39.343676 run patchelf(pid=27436): Terminated: ok {rc=0} 04:39:39.473402 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27433): Process ended prematurely: osmo-stp_10.42.42.5(pid=27433) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27433)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 04:39:39.483966 tst iperf3.py:8: Test FAILED (7.6 sec) 04:39:39.512524 run osmo-hlr_10.42.42.2(pid=27430): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27430)] 04:39:39.562349 run osmo-hlr_10.42.42.2(pid=27430): stdout: | (launched: 2022-12-10_04:39:36.160476) 04:39:39.613721 run osmo-hlr_10.42.42.2(pid=27430): stderr: | 20221210043936357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043936357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043936357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043936357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043936357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043936357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043936369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043936378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043936378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043936378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:39.665443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27425): Terminating (SIGTERM) 04:39:39.706927 run iperf3-srv_10.42.42.10(pid=27426): Terminating (SIGTERM) 04:39:39.748281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27429): Terminating (SIGTERM) 04:39:39.789852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27432): Terminating (SIGTERM) 04:39:39.831087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27435): Terminating (SIGTERM) 04:39:39.872607 --- ParallelTerminationStrategy: PID 27425 died... 04:39:39.892593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27425): Terminated: ok {rc=0} 04:39:39.938564 --- ParallelTerminationStrategy: PID 27426 died... 04:39:39.958172 run iperf3-srv_10.42.42.10(pid=27426): Terminated {rc=256} 04:39:40.004146 --- ParallelTerminationStrategy: PID 27429 died... 04:39:40.023611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27429): Terminated: ok {rc=0} 04:39:40.069843 --- ParallelTerminationStrategy: PID 27432 died... 04:39:40.089475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27432): Terminated: ok {rc=0} 04:39:40.135032 --- ParallelTerminationStrategy: PID 27435 died... 04:39:40.154492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27435): Terminated: ok {rc=0} 04:39:40.241101 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:39:41.390322 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:41.402583 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:39:41.464644 tst iperf3m4.py: using LAC 26051 04:39:41.591492 tst iperf3m4.py: using RAC 41 04:39:41.718329 tst iperf3m4.py: using CellId 26051 04:39:41.843086 tst iperf3m4.py: using BVCI 26052 04:39:41.958899 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:41.970802 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:41.982350 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:41.993888 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:42.005276 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:42.016612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:42.028196 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:42.039443 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:39:42.050990 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:39:42.171036 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:39:42.292051 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:39:42.408840 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:39:42.527879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:39:42.745838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:43.069733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27437): Launched 04:39:43.350233 run iperf3-srv_10.42.42.10(pid=27438): Launched 04:39:43.470514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:39:43.688193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:44.011590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27439): Launched 04:39:44.291189 run iperf3-srv_10.42.42.10(pid=27440): Launched 04:39:44.411503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:39:44.628618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:44.951178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27441): Launched 04:39:45.230905 run iperf3-srv_10.42.42.10(pid=27442): Launched 04:39:45.350765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:39:45.567939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:45.912118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27443): Launched 04:39:46.266185 run iperf3-srv_10.42.42.10(pid=27444): Launched 04:39:46.426495 tst iperf3m4.py:8: start network... 04:39:46.697631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:47.264508 run create_hlr_db(pid=27445): Launched 04:39:47.423225 bus /gobi_6: Setting Powered False 04:39:48.487120 run create_hlr_db(pid=27445): Terminated: ok {rc=0} 04:39:48.935328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27447): Launched 04:39:49.257154 run osmo-hlr_10.42.42.2(pid=27448): Launched 04:39:49.379699 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:49.939103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27450): Launched 04:39:50.261744 run osmo-stp_10.42.42.5(pid=27451): Launched 04:39:50.383733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:50.937546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27453): Launched 04:39:51.059515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:51.330801 run patchelf(pid=27454): Launched 04:39:51.508545 run osmo-stp_10.42.42.5(pid=27451): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27451)] 04:39:51.645321 run osmo-stp_10.42.42.5(pid=27451): stdout: | (launched: 2022-12-10_04:39:50.202568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:51.783174 run osmo-stp_10.42.42.5(pid=27451): stderr: | 20221210043950396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043950396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043950397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043950397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043950397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043950398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043950398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:51.920865 run osmo-stp_10.42.42.5(pid=27451): stdout: | (launched: 2022-12-10_04:39:50.202568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:52.052582 run osmo-stp_10.42.42.5(pid=27451): stderr: | 20221210043950396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210043950396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210043950397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210043950397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210043950397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210043950398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210043950398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:52.209026 run patchelf(pid=27454): Terminating (SIGINT) 04:39:52.389180 run patchelf(pid=27454): Terminated: ok {rc=0} 04:39:52.519437 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27451): Process ended prematurely: osmo-stp_10.42.42.5(pid=27451) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27451)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:39:52.530002 tst iperf3m4.py:8: Test FAILED (11.2 sec) 04:39:52.559338 run osmo-hlr_10.42.42.2(pid=27448): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27448)] 04:39:52.609165 run osmo-hlr_10.42.42.2(pid=27448): stdout: | (launched: 2022-12-10_04:39:49.198034) 04:39:52.660557 run osmo-hlr_10.42.42.2(pid=27448): stderr: | 20221210043949399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210043949399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210043949399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210043949399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210043949399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210043949399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210043949410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210043949419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210043949419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210043949419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:52.712473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27437): Terminating (SIGTERM) 04:39:52.754304 run iperf3-srv_10.42.42.10(pid=27438): Terminating (SIGTERM) 04:39:52.796247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27439): Terminating (SIGTERM) 04:39:52.837912 run iperf3-srv_10.42.42.10(pid=27440): Terminating (SIGTERM) 04:39:52.879528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27441): Terminating (SIGTERM) 04:39:52.921162 run iperf3-srv_10.42.42.10(pid=27442): Terminating (SIGTERM) 04:39:52.962783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27443): Terminating (SIGTERM) 04:39:53.004388 run iperf3-srv_10.42.42.10(pid=27444): Terminating (SIGTERM) 04:39:53.045944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27447): Terminating (SIGTERM) 04:39:53.087830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27450): Terminating (SIGTERM) 04:39:53.129543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27453): Terminating (SIGTERM) 04:39:53.171461 --- ParallelTerminationStrategy: PID 27437 died... 04:39:53.191464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27437): Terminated: ok {rc=0} 04:39:53.238340 --- ParallelTerminationStrategy: PID 27438 died... 04:39:53.258008 run iperf3-srv_10.42.42.10(pid=27438): Terminated {rc=256} 04:39:53.303874 --- ParallelTerminationStrategy: PID 27439 died... 04:39:53.323442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27439): Terminated: ok {rc=0} 04:39:53.369666 --- ParallelTerminationStrategy: PID 27440 died... 04:39:53.389209 run iperf3-srv_10.42.42.10(pid=27440): Terminated {rc=256} 04:39:53.434811 --- ParallelTerminationStrategy: PID 27441 died... 04:39:53.454381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27441): Terminated: ok {rc=0} 04:39:53.500375 --- ParallelTerminationStrategy: PID 27442 died... 04:39:53.519938 run iperf3-srv_10.42.42.10(pid=27442): Terminated {rc=256} 04:39:53.565807 --- ParallelTerminationStrategy: PID 27443 died... 04:39:53.585473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27443): Terminated: ok {rc=0} 04:39:53.631438 --- ParallelTerminationStrategy: PID 27444 died... 04:39:53.651195 run iperf3-srv_10.42.42.10(pid=27444): Terminated {rc=256} 04:39:53.696721 --- ParallelTerminationStrategy: PID 27447 died... 04:39:53.716252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27447): Terminated: ok {rc=0} 04:39:53.761880 --- ParallelTerminationStrategy: PID 27450 died... 04:39:53.781424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27450): Terminated: ok {rc=0} 04:39:53.827206 --- ParallelTerminationStrategy: PID 27453 died... 04:39:53.846720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27453): Terminated: ok {rc=0} 04:39:53.933585 bus /gobi_4: Setting Powered False 04:39:55.033368 bus /gobi_4: Setting Powered False 04:39:56.148657 bus /gobi_1: Setting Powered False 04:39:57.246720 bus /gobi_1: Setting Powered False 04:39:58.361127 bus /gobi_0: Setting Powered False 04:39:59.457426 bus /gobi_0: Setting Powered False 04:40:00.572462 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:40:01.683553 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:01.696161 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:01.778975 tst ping.py: using LAC 26052 04:40:01.906452 tst ping.py: using RAC 42 04:40:02.081346 tst ping.py: using CellId 26052 04:40:02.269298 tst ping.py: using BVCI 26053 04:40:02.408754 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:02.424524 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:02.439755 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:02.454063 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:02.469283 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:02.482780 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:02.497118 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:02.510697 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:02.633186 tst ping.py:19: start network... 04:40:02.847107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:03.336053 run create_hlr_db(pid=27465): Launched 04:40:03.463968 bus /gobi_6: Setting Powered False 04:40:04.526032 run create_hlr_db(pid=27465): Terminated: ok {rc=0} 04:40:04.966652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27467): Launched 04:40:05.282871 run osmo-hlr_10.42.42.2(pid=27468): Launched 04:40:05.403418 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:05.954763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27470): Launched 04:40:06.269870 run osmo-stp_10.42.42.5(pid=27471): Launched 04:40:06.389464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:06.933982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27473): Launched 04:40:07.053658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:07.320287 run patchelf(pid=27474): Launched 04:40:07.494887 run osmo-stp_10.42.42.5(pid=27471): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27471)] 04:40:07.628682 run osmo-stp_10.42.42.5(pid=27471): stdout: | (launched: 2022-12-10_04:40:06.211893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:07.763603 run osmo-stp_10.42.42.5(pid=27471): stderr: | 20221210044006403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044006403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044006404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044006404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044006404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044006405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044006405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:07.898153 run osmo-stp_10.42.42.5(pid=27471): stdout: | (launched: 2022-12-10_04:40:06.211893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:08.026762 run osmo-stp_10.42.42.5(pid=27471): stderr: | 20221210044006403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044006403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044006404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044006404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044006404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044006405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044006405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:08.179751 run patchelf(pid=27474): Terminating (SIGINT) 04:40:08.356054 run patchelf(pid=27474): Terminated: ok {rc=0} 04:40:08.483249 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27471): Process ended prematurely: osmo-stp_10.42.42.5(pid=27471) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27471)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 04:40:08.493120 tst ping.py:22: Test FAILED (6.8 sec) 04:40:08.520898 run osmo-hlr_10.42.42.2(pid=27468): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27468)] 04:40:08.570361 run osmo-hlr_10.42.42.2(pid=27468): stdout: | (launched: 2022-12-10_04:40:05.224486) 04:40:08.621390 run osmo-hlr_10.42.42.2(pid=27468): stderr: | 20221210044005423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044005423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044005423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044005423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044005423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044005423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044005436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044005446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044005446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044005446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:08.672599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27467): Terminating (SIGTERM) 04:40:08.713797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27470): Terminating (SIGTERM) 04:40:08.754956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27473): Terminating (SIGTERM) 04:40:08.797139 --- ParallelTerminationStrategy: PID 27467 died... 04:40:08.817045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27467): Terminated: ok {rc=0} 04:40:08.862509 --- ParallelTerminationStrategy: PID 27470 died... 04:40:08.881564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27470): Terminated: ok {rc=0} 04:40:08.927030 --- ParallelTerminationStrategy: PID 27473 died... 04:40:08.946327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27473): Terminated: ok {rc=0} 04:40:09.033393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:40:10.120010 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.132589 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:10.194302 tst ping_idle_ping.py: using LAC 26053 04:40:10.321017 tst ping_idle_ping.py: using RAC 43 04:40:10.444007 tst ping_idle_ping.py: using CellId 26053 04:40:10.565983 tst ping_idle_ping.py: using BVCI 26054 04:40:10.679655 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.691139 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.702555 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.713934 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.725128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.736386 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.747870 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:10.759215 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:10.880617 tst ping_idle_ping.py:24: start network... 04:40:11.093981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:11.584436 run create_hlr_db(pid=27475): Launched 04:40:11.711671 bus /gobi_6: Setting Powered False 04:40:12.785479 run create_hlr_db(pid=27475): Terminated: ok {rc=0} 04:40:13.243095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27561): Launched 04:40:13.572795 run osmo-hlr_10.42.42.2(pid=27586): Launched 04:40:13.797320 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:14.395441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27731): Launched 04:40:14.720661 run osmo-stp_10.42.42.5(pid=27761): Launched 04:40:14.929796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:15.486337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27834): Launched 04:40:15.606914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:15.875431 run patchelf(pid=27835): Launched 04:40:16.061484 run osmo-stp_10.42.42.5(pid=27761): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27761)] 04:40:16.194285 run osmo-stp_10.42.42.5(pid=27761): stdout: | (launched: 2022-12-10_04:40:14.664847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:16.328512 run osmo-stp_10.42.42.5(pid=27761): stderr: | 20221210044014995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044014995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044014995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044014995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044015000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044015000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044015000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:16.464812 run osmo-stp_10.42.42.5(pid=27761): stdout: | (launched: 2022-12-10_04:40:14.664847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:16.595851 run osmo-stp_10.42.42.5(pid=27761): stderr: | 20221210044014995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044014995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044014995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044014995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044015000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044015000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044015000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:16.751629 run patchelf(pid=27835): Terminating (SIGINT) 04:40:16.931605 run patchelf(pid=27835): Terminated: ok {rc=0} 04:40:17.061577 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27761): Process ended prematurely: osmo-stp_10.42.42.5(pid=27761) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27761)] [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:40:17.071479 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 04:40:17.100610 run osmo-hlr_10.42.42.2(pid=27586): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27586)] 04:40:17.151001 run osmo-hlr_10.42.42.2(pid=27586): stdout: | (launched: 2022-12-10_04:40:13.510954) 04:40:17.202910 run osmo-hlr_10.42.42.2(pid=27586): stderr: | 20221210044013790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044013790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044013790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044013790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044013790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044013790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044013811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044013828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044013828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044013828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:17.254511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27561): Terminating (SIGTERM) 04:40:17.295858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27731): Terminating (SIGTERM) 04:40:17.337333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27834): Terminating (SIGTERM) 04:40:17.378880 --- ParallelTerminationStrategy: PID 27561 died... 04:40:17.398507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27561): Terminated: ok {rc=0} 04:40:17.444314 --- ParallelTerminationStrategy: PID 27731 died... 04:40:17.463814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27731): Terminated: ok {rc=0} 04:40:17.509465 --- ParallelTerminationStrategy: PID 27834 died... 04:40:17.528604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27834): Terminated: ok {rc=0} 04:40:17.615685 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 04:40:18.909089 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:40:18.916836 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:40:18.942387 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:40:18.977277 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:40:19.031779 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:40:19.055418 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:40:19.089915 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:40:19.653247 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:40:19.658491 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:19.670313 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:40:19.729172 tst switch_tch_pdch.py: using LAC 26054 04:40:19.843146 tst switch_tch_pdch.py: using RAC 44 04:40:19.960113 tst switch_tch_pdch.py: using CellId 26054 04:40:20.075978 tst switch_tch_pdch.py: using BVCI 26055 04:40:20.183007 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:20.194658 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:20.206129 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:20.217810 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:20.229378 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:20.240690 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:20.252435 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:40:20.264059 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:40:20.384629 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:40:20.501817 tst switch_tch_pdch.py:51: start network... 04:40:20.701032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:21.159863 run create_hlr_db(pid=27839): Launched 04:40:21.273064 bus /gobi_6: Setting Powered False 04:40:22.336757 run create_hlr_db(pid=27839): Terminated: ok {rc=0} 04:40:22.778426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27841): Launched 04:40:23.094498 run osmo-hlr_10.42.42.2(pid=27842): Launched 04:40:23.286359 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:23.929636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27947): Launched 04:40:24.244075 run osmo-stp_10.42.42.5(pid=28019): Launched 04:40:24.441253 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:25.096718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28024): Launched 04:40:25.224288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:25.483654 run patchelf(pid=28025): Launched 04:40:25.668315 run osmo-stp_10.42.42.5(pid=28019): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28019)] 04:40:25.798214 run osmo-stp_10.42.42.5(pid=28019): stdout: | (launched: 2022-12-10_04:40:24.187796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:25.927920 run osmo-stp_10.42.42.5(pid=28019): stderr: | 20221210044024424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044024424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044024424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044024425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044024427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044024427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044024427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:26.059130 run osmo-stp_10.42.42.5(pid=28019): stdout: | (launched: 2022-12-10_04:40:24.187796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:26.185383 run osmo-stp_10.42.42.5(pid=28019): stderr: | 20221210044024424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044024424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044024424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044024425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044024427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044024427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044024427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:26.333839 run patchelf(pid=28025): Terminating (SIGINT) 04:40:26.504592 run patchelf(pid=28025): Terminated: ok {rc=0} 04:40:26.629387 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28019): Process ended prematurely: osmo-stp_10.42.42.5(pid=28019) [trial-2369↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28019)] [trial-2369↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:40:26.639648 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 04:40:26.670320 run osmo-hlr_10.42.42.2(pid=27842): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27842)] 04:40:26.720237 run osmo-hlr_10.42.42.2(pid=27842): stdout: | (launched: 2022-12-10_04:40:23.036165) 04:40:26.773259 run osmo-hlr_10.42.42.2(pid=27842): stderr: | 20221210044023325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044023325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044023325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044023325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044023325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044023325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044023339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044023354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044023354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044023354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:26.825446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27841): Terminating (SIGTERM) 04:40:26.867903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27947): Terminating (SIGTERM) 04:40:26.911985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28024): Terminating (SIGTERM) 04:40:26.956197 --- ParallelTerminationStrategy: PID 27841 died... 04:40:26.977237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27841): Terminated: ok {rc=0} 04:40:27.025640 --- ParallelTerminationStrategy: PID 27947 died... 04:40:27.045142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27947): Terminated: ok {rc=0} 04:40:27.093065 --- ParallelTerminationStrategy: PID 28024 died... 04:40:27.112535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28024): Terminated: ok {rc=0} 04:40:27.201059 bus /gobi_0: Setting Powered False 04:40:28.298854 bus /gobi_0: Setting Powered False 04:40:29.412046 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 sms:nanobts+band-900 --------------------------------------------------------------------- 04:40:30.652614 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:40:30.657528 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:40:30.690042 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:40:30.716564 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 04:40:30.769164 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:40:30.802272 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:40:30.829909 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 04:40:31.380637 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 04:40:31.385542 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:31.406222 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 04:40:31.464297 tst mo_mt_sms.py: using LAC 26055 04:40:31.582381 tst mo_mt_sms.py: using RAC 45 04:40:31.702511 tst mo_mt_sms.py: using CellId 26055 04:40:31.821396 tst mo_mt_sms.py: using BVCI 26056 04:40:31.938979 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:31.951179 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:31.965276 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:31.978173 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:31.990262 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:32.003149 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 04:40:32.125424 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 04:40:32.248605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:32.738061 run create_hlr_db(pid=28030): Launched 04:40:32.865564 bus /gobi_6: Setting Powered False 04:40:33.927842 run create_hlr_db(pid=28030): Terminated: ok {rc=0} 04:40:34.349870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28032): Launched 04:40:34.646822 run osmo-hlr_10.42.42.2(pid=28033): Launched 04:40:34.759672 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:35.271940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28035): Launched 04:40:35.566439 run osmo-stp_10.42.42.5(pid=28036): Launched 04:40:35.677972 run osmo-msc_10.42.42.6: Starting osmo-msc 04:40:36.214390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28038): Launched 04:40:36.511380 run osmo-msc_10.42.42.6(pid=28039): Launched 04:40:36.676870 run osmo-stp_10.42.42.5(pid=28036): ERR: Terminated: ERROR {rc=1} [trial-2369↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28036)] 04:40:36.802474 run osmo-stp_10.42.42.5(pid=28036): stdout: | (launched: 2022-12-10_04:40:35.511942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:36.928770 run osmo-stp_10.42.42.5(pid=28036): stderr: | 20221210044035681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044035681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044035681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044035682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044035684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044035684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044035684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:37.052042 run osmo-stp_10.42.42.5(pid=28036): stdout: | (launched: 2022-12-10_04:40:35.511942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:37.170355 run osmo-stp_10.42.42.5(pid=28036): stderr: | 20221210044035681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044035681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044035681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044035682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044035684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044035684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044035684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:37.311391 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28036): Process ended prematurely: osmo-stp_10.42.42.5(pid=28036) [trial-2369↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28036)] [trial-2369↪sms:nanobts+band-900↪mo_mt_sms.py:16] 04:40:37.319750 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 04:40:37.346331 run osmo-hlr_10.42.42.2(pid=28033): ERR: Terminated: ERROR {rc=237} [trial-2369↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28033)] 04:40:37.394163 run osmo-hlr_10.42.42.2(pid=28033): stdout: | (launched: 2022-12-10_04:40:34.592269) 04:40:37.443349 run osmo-hlr_10.42.42.2(pid=28033): stderr: | 20221210044034766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044034766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044034766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044034766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044034766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044034766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044034778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044034787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044034787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044034787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:37.512583 run osmo-msc_10.42.42.6(pid=28039): ERR: Terminated: ERROR {rc=2} [trial-2369↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28039)] 04:40:37.560424 run osmo-msc_10.42.42.6(pid=28039): stdout: | (launched: 2022-12-10_04:40:36.456473) 04:40:37.609498 run osmo-msc_10.42.42.6(pid=28039): stderr: | 20221210044036730 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044036730 DLGLOBAL DEBUG validating counter group 0x7f9eab66fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044036730 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044036730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044036730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044036731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044036732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044036733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044036733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044036733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:40:37.658967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28032): Terminating (SIGTERM) 04:40:37.698645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28035): Terminating (SIGTERM) 04:40:37.738214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28038): Terminating (SIGTERM) 04:40:37.778250 --- ParallelTerminationStrategy: PID 28032 died... 04:40:37.797246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28032): Terminated: ok {rc=0} 04:40:37.841487 --- ParallelTerminationStrategy: PID 28035 died... 04:40:37.859929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28035): Terminated: ok {rc=0} 04:40:37.904317 --- ParallelTerminationStrategy: PID 28038 died... 04:40:37.922814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28038): Terminated: ok {rc=0} 04:40:38.005637 bus /sierra_3: Setting Powered False 04:40:39.103264 bus /sierra_3: Setting Powered False 04:40:40.220549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 04:40:41.451506 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:40:41.456207 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:40:41.489698 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 04:40:41.496394 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 04:40:41.531390 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:40:41.563570 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 04:40:41.570254 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 04:40:42.091078 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 04:40:42.097903 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 04:40:42.109713 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 04:40:42.156840 tst assert_extension.py: using LAC 26056 04:40:42.279944 tst assert_extension.py: using RAC 46 04:40:42.398228 tst assert_extension.py: using CellId 26056 04:40:42.517511 tst assert_extension.py: using BVCI 26057 04:40:42.633169 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 04:40:42.744491 tst assert_extension.py:10: start nitb and bts... 04:40:42.942655 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:40:43.548519 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28045): Launched 04:40:43.845743 run osmo-nitb_10.42.42.2(pid=28046): Launched 04:40:44.009288 run osmo-nitb_10.42.42.2(pid=28046): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28046)] 04:40:44.142131 run osmo-nitb_10.42.42.2(pid=28046): stdout: | (launched: 2022-12-10_04:40:43.790686) 04:40:44.276769 run osmo-nitb_10.42.42.2(pid=28046): stderr: | (launched: 2022-12-10_04:40:43.834782) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:40:44.411404 run osmo-nitb_10.42.42.2(pid=28046): stdout: | (launched: 2022-12-10_04:40:43.790686) 04:40:44.540437 run osmo-nitb_10.42.42.2(pid=28046): stderr: | (launched: 2022-12-10_04:40:43.834782) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28046): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28046) [trial-2369↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28046)] 04:40:44.956687 tst osmo-nitb_10.42.42.2(pid=28046): stdout: | (launched: 2022-12-10_04:40:43.790686) 04:40:45.076315 tst osmo-nitb_10.42.42.2(pid=28046): stderr: | (launched: 2022-12-10_04:40:43.834782) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:40:45.216754 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28046): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28046) [trial-2369↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28046)] [trial-2369↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 04:40:45.225377 tst assert_extension.py:12: Test FAILED (3.1 sec) 04:40:45.231877 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28045): Terminating (SIGTERM) 04:40:45.440861 --- ParallelTerminationStrategy: PID 28045 died... 04:40:45.461173 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28045): Terminated: ok {rc=0} 04:40:45.546358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 ussd:nanobts+band-900 --------------------------------------------------------------------- 04:40:46.731232 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:40:46.741063 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:40:46.778968 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:40:46.807473 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 04:40:46.844867 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:40:46.903196 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:40:46.947614 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 04:40:47.434769 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 04:40:47.440715 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:47.452370 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 04:40:47.502035 tst assert_extension.py: using LAC 26057 04:40:47.637508 tst assert_extension.py: using RAC 47 04:40:47.755558 tst assert_extension.py: using CellId 26057 04:40:47.869735 tst assert_extension.py: using BVCI 26058 04:40:47.985242 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:47.996494 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:48.007830 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:48.019496 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:48.031301 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:40:48.043179 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 04:40:48.158457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:48.617625 run create_hlr_db(pid=28050): Launched 04:40:48.729514 bus /sierra_2: Setting Powered False 04:40:49.789200 run create_hlr_db(pid=28050): Terminated: ok {rc=0} 04:40:50.223415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28052): Launched 04:40:50.541251 run osmo-hlr_10.42.42.2(pid=28053): Launched 04:40:50.663290 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:51.209738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28055): Launched 04:40:51.525537 run osmo-stp_10.42.42.5(pid=28056): Launched 04:40:51.646331 run osmo-msc_10.42.42.6: Starting osmo-msc 04:40:52.217264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28058): Launched 04:40:52.533665 run osmo-msc_10.42.42.6(pid=28059): Launched 04:40:52.711353 run osmo-stp_10.42.42.5(pid=28056): ERR: Terminated: ERROR {rc=1} [trial-2369↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28056)] 04:40:52.844523 run osmo-stp_10.42.42.5(pid=28056): stdout: | (launched: 2022-12-10_04:40:51.467322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:52.978077 run osmo-stp_10.42.42.5(pid=28056): stderr: | 20221210044051660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044051660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044051660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044051661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044051661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044051661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044051661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:53.111112 run osmo-stp_10.42.42.5(pid=28056): stdout: | (launched: 2022-12-10_04:40:51.467322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:53.236572 run osmo-stp_10.42.42.5(pid=28056): stderr: | 20221210044051660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044051660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044051660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044051661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044051661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044051661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044051661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:53.386972 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28056): Process ended prematurely: osmo-stp_10.42.42.5(pid=28056) [trial-2369↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28056)] [trial-2369↪ussd:nanobts+band-900↪assert_extension.py:17] 04:40:53.395996 tst assert_extension.py:17: Test FAILED (5.9 sec) 04:40:53.423549 run osmo-hlr_10.42.42.2(pid=28053): ERR: Terminated: ERROR {rc=237} [trial-2369↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28053)] 04:40:53.473231 run osmo-hlr_10.42.42.2(pid=28053): stdout: | (launched: 2022-12-10_04:40:50.482411) 04:40:53.525120 run osmo-hlr_10.42.42.2(pid=28053): stderr: | 20221210044050681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044050681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044050681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044050681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044050681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044050681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044050697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044050705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044050705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044050705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:53.597537 run osmo-msc_10.42.42.6(pid=28059): ERR: Terminated: ERROR {rc=2} [trial-2369↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28059)] 04:40:53.647356 run osmo-msc_10.42.42.6(pid=28059): stdout: | (launched: 2022-12-10_04:40:52.475365) 04:40:53.698821 run osmo-msc_10.42.42.6(pid=28059): stderr: | 20221210044052802 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044052802 DLGLOBAL DEBUG validating counter group 0x7fcc7e315c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044052802 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044052802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044052802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044052802 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044052804 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044052804 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044052804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044052805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:40:53.751111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28052): Terminating (SIGTERM) 04:40:53.792740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28055): Terminating (SIGTERM) 04:40:53.834643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28058): Terminating (SIGTERM) 04:40:53.876726 --- ParallelTerminationStrategy: PID 28052 died... 04:40:53.896477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28052): Terminated: ok {rc=0} 04:40:53.942926 --- ParallelTerminationStrategy: PID 28055 died... 04:40:53.962572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28055): Terminated: ok {rc=0} 04:40:54.008674 --- ParallelTerminationStrategy: PID 28058 died... 04:40:54.028325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28058): Terminated: ok {rc=0} 04:40:54.116327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:40:55.330220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:40:55.338594 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:40:55.372011 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:40:55.399911 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:40:55.452464 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:40:55.485745 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:40:55.513091 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:40:56.067180 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:40:56.119203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:40:56.130840 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:40:56.197952 tst mo_mt_call.py: using LAC 26058 04:40:56.323333 tst mo_mt_call.py: using RAC 48 04:40:56.448534 tst mo_mt_call.py: using CellId 26058 04:40:56.575406 tst mo_mt_call.py: using BVCI 26059 04:40:56.693464 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:40:56.705182 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:40:56.716729 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:40:56.728312 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:40:56.740022 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:40:56.751563 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:40:56.863883 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:40:56.981618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:57.478934 run create_hlr_db(pid=28065): Launched 04:40:57.610854 bus /sierra_2: Setting Powered False 04:40:58.672429 run create_hlr_db(pid=28065): Terminated: ok {rc=0} 04:40:59.119367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28067): Launched 04:40:59.440671 run osmo-hlr_10.42.42.2(pid=28068): Launched 04:40:59.562717 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:00.116039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28070): Launched 04:41:00.465644 run osmo-stp_10.42.42.5(pid=28071): Launched 04:41:00.587518 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:01.193726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28073): Launched 04:41:01.536344 run osmo-msc_10.42.42.6(pid=28074): Launched 04:41:01.776943 run osmo-stp_10.42.42.5(pid=28071): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28071)] 04:41:02.066146 run osmo-stp_10.42.42.5(pid=28071): stdout: | (launched: 2022-12-10_04:41:00.406747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:02.293928 run osmo-stp_10.42.42.5(pid=28071): stderr: | 20221210044100601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044100601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044100602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044100602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044100602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044100603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044100603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:02.428008 run osmo-stp_10.42.42.5(pid=28071): stdout: | (launched: 2022-12-10_04:41:00.406747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:02.556311 run osmo-stp_10.42.42.5(pid=28071): stderr: | 20221210044100601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044100601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044100602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044100602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044100602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044100603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044100603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:02.710989 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28071): Process ended prematurely: osmo-stp_10.42.42.5(pid=28071) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28071)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:41:02.720705 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 04:41:02.749118 run osmo-hlr_10.42.42.2(pid=28068): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28068)] 04:41:02.799832 run osmo-hlr_10.42.42.2(pid=28068): stdout: | (launched: 2022-12-10_04:40:59.381814) 04:41:02.852270 run osmo-hlr_10.42.42.2(pid=28068): stderr: | 20221210044059583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044059583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044059583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044059583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044059583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044059583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044059596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044059606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044059606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044059606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:02.925406 run osmo-msc_10.42.42.6(pid=28074): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28074)] 04:41:02.975983 run osmo-msc_10.42.42.6(pid=28074): stdout: | (launched: 2022-12-10_04:41:01.471992) 04:41:03.028238 run osmo-msc_10.42.42.6(pid=28074): stderr: | 20221210044102029 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044102029 DLGLOBAL DEBUG validating counter group 0x7fb6d16adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044102029 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044102029 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044102030 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044102030 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044102033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044102034 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044102034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044102034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:03.080798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28067): Terminating (SIGTERM) 04:41:03.122933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28070): Terminating (SIGTERM) 04:41:03.165088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28073): Terminating (SIGTERM) 04:41:03.207350 --- ParallelTerminationStrategy: PID 28067 died... 04:41:03.227531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28067): Terminated: ok {rc=0} 04:41:03.273922 --- ParallelTerminationStrategy: PID 28070 died... 04:41:03.293479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28070): Terminated: ok {rc=0} 04:41:03.339675 --- ParallelTerminationStrategy: PID 28073 died... 04:41:03.359363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28073): Terminated: ok {rc=0} 04:41:03.447289 bus /sierra_3: Setting Powered False 04:41:04.545992 bus /sierra_3: Setting Powered False 04:41:05.662323 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:41:06.811728 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:06.824043 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:41:06.893946 tst mo_mt_call_osmux.py: using LAC 26059 04:41:07.021307 tst mo_mt_call_osmux.py: using RAC 49 04:41:07.147454 tst mo_mt_call_osmux.py: using CellId 26059 04:41:07.273338 tst mo_mt_call_osmux.py: using BVCI 26060 04:41:07.389910 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:07.401519 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:07.412850 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:07.424354 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:07.435935 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:07.447402 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:41:07.561965 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:41:07.678693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:08.176708 run create_hlr_db(pid=28076): Launched 04:41:08.305977 bus /sierra_2: Setting Powered False 04:41:09.370009 run create_hlr_db(pid=28076): Terminated: ok {rc=0} 04:41:09.800379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28078): Launched 04:41:10.123260 run osmo-hlr_10.42.42.2(pid=28079): Launched 04:41:10.244914 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:10.805073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28081): Launched 04:41:11.126813 run osmo-stp_10.42.42.5(pid=28082): Launched 04:41:11.248038 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:11.830675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28084): Launched 04:41:12.151937 run osmo-msc_10.42.42.6(pid=28085): Launched 04:41:12.330167 run osmo-stp_10.42.42.5(pid=28082): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28082)] 04:41:12.465667 run osmo-stp_10.42.42.5(pid=28082): stdout: | (launched: 2022-12-10_04:41:11.067420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:12.602571 run osmo-stp_10.42.42.5(pid=28082): stderr: | 20221210044111262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044111262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044111262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044111263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044111263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044111263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044111263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:12.738503 run osmo-stp_10.42.42.5(pid=28082): stdout: | (launched: 2022-12-10_04:41:11.067420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:12.866919 run osmo-stp_10.42.42.5(pid=28082): stderr: | 20221210044111262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044111262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044111262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044111263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044111263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044111263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044111263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:13.020399 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28082): Process ended prematurely: osmo-stp_10.42.42.5(pid=28082) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28082)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:41:13.030238 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:41:13.058455 run osmo-hlr_10.42.42.2(pid=28079): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28079)] 04:41:13.108554 run osmo-hlr_10.42.42.2(pid=28079): stdout: | (launched: 2022-12-10_04:41:10.064392) 04:41:13.160339 run osmo-hlr_10.42.42.2(pid=28079): stderr: | 20221210044110262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044110262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044110262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044110262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044110262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044110262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044110276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044110287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044110287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044110287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:13.232754 run osmo-msc_10.42.42.6(pid=28085): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28085)] 04:41:13.282617 run osmo-msc_10.42.42.6(pid=28085): stdout: | (launched: 2022-12-10_04:41:12.092820) 04:41:13.334320 run osmo-msc_10.42.42.6(pid=28085): stderr: | 20221210044112417 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044112417 DLGLOBAL DEBUG validating counter group 0x7fc218fa9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044112417 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044112417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044112418 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044112418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044112419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044112420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044112420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044112420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:13.386327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28078): Terminating (SIGTERM) 04:41:13.428207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28081): Terminating (SIGTERM) 04:41:13.470155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28084): Terminating (SIGTERM) 04:41:13.512256 --- ParallelTerminationStrategy: PID 28078 died... 04:41:13.532249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28078): Terminated: ok {rc=0} 04:41:13.579027 --- ParallelTerminationStrategy: PID 28081 died... 04:41:13.598796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28081): Terminated: ok {rc=0} 04:41:13.644853 --- ParallelTerminationStrategy: PID 28084 died... 04:41:13.664885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28084): Terminated: ok {rc=0} 04:41:13.752283 bus /sierra_3: Setting Powered False 04:41:14.851847 bus /sierra_3: Setting Powered False 04:41:15.970703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:41:17.243654 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:17.251676 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:41:17.285867 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:41:17.312608 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:41:17.365758 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:41:17.398639 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:41:17.425104 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:41:17.975219 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:41:18.023437 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:18.034600 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:41:18.100774 tst mo_mt_call.py: using LAC 26060 04:41:18.218299 tst mo_mt_call.py: using RAC 50 04:41:18.334860 tst mo_mt_call.py: using CellId 26060 04:41:18.453936 tst mo_mt_call.py: using BVCI 26061 04:41:18.570218 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:18.582462 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:18.594218 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:18.605964 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:18.617711 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:18.629586 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:41:18.742932 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:41:18.857534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:19.323495 run create_hlr_db(pid=28090): Launched 04:41:19.438866 bus /sierra_2: Setting Powered False 04:41:20.498997 run create_hlr_db(pid=28090): Terminated: ok {rc=0} 04:41:20.940325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28092): Launched 04:41:21.260540 run osmo-hlr_10.42.42.2(pid=28093): Launched 04:41:21.383368 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:21.939849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28095): Launched 04:41:22.260644 run osmo-stp_10.42.42.5(pid=28096): Launched 04:41:22.383115 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:22.963882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28098): Launched 04:41:23.285699 run osmo-msc_10.42.42.6(pid=28099): Launched 04:41:23.464259 run osmo-stp_10.42.42.5(pid=28096): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28096)] 04:41:23.600063 run osmo-stp_10.42.42.5(pid=28096): stdout: | (launched: 2022-12-10_04:41:22.201889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:23.735711 run osmo-stp_10.42.42.5(pid=28096): stderr: | 20221210044122397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044122397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044122397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044122397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044122398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044122398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044122398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:23.871059 run osmo-stp_10.42.42.5(pid=28096): stdout: | (launched: 2022-12-10_04:41:22.201889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:23.998900 run osmo-stp_10.42.42.5(pid=28096): stderr: | 20221210044122397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044122397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044122397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044122397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044122398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044122398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044122398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:24.151809 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28096): Process ended prematurely: osmo-stp_10.42.42.5(pid=28096) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28096)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:41:24.161882 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:41:24.190019 run osmo-hlr_10.42.42.2(pid=28093): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28093)] 04:41:24.239877 run osmo-hlr_10.42.42.2(pid=28093): stdout: | (launched: 2022-12-10_04:41:21.202054) 04:41:24.291337 run osmo-hlr_10.42.42.2(pid=28093): stderr: | 20221210044121402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044121402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044121402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044121402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044121402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044121402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044121414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044121423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044121423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044121423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:24.363467 run osmo-msc_10.42.42.6(pid=28099): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28099)] 04:41:24.413280 run osmo-msc_10.42.42.6(pid=28099): stdout: | (launched: 2022-12-10_04:41:23.226515) 04:41:24.464520 run osmo-msc_10.42.42.6(pid=28099): stderr: | 20221210044123551 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044123551 DLGLOBAL DEBUG validating counter group 0x7f4c6e2c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044123551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044123551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044123551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044123551 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044123553 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044123553 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044123554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044123554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:24.516236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28092): Terminating (SIGTERM) 04:41:24.557673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28095): Terminating (SIGTERM) 04:41:24.599539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28098): Terminating (SIGTERM) 04:41:24.641663 --- ParallelTerminationStrategy: PID 28092 died... 04:41:24.661662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28092): Terminated: ok {rc=0} 04:41:24.707958 --- ParallelTerminationStrategy: PID 28095 died... 04:41:24.727588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28095): Terminated: ok {rc=0} 04:41:24.773458 --- ParallelTerminationStrategy: PID 28098 died... 04:41:24.793419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28098): Terminated: ok {rc=0} 04:41:24.881954 bus /sierra_3: Setting Powered False 04:41:25.979629 bus /sierra_3: Setting Powered False 04:41:27.095261 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:41:28.237581 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:28.249349 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:41:28.319286 tst mo_mt_call_osmux.py: using LAC 26061 04:41:28.436853 tst mo_mt_call_osmux.py: using RAC 51 04:41:28.552639 tst mo_mt_call_osmux.py: using CellId 26061 04:41:28.668717 tst mo_mt_call_osmux.py: using BVCI 26062 04:41:28.777353 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:28.788422 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:28.799418 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:28.810894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:28.822189 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:41:28.833529 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:41:28.950560 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:41:29.066626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:29.534153 run create_hlr_db(pid=28101): Launched 04:41:29.648752 bus /sierra_2: Setting Powered False 04:41:30.709591 run create_hlr_db(pid=28101): Terminated: ok {rc=0} 04:41:31.150384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Launched 04:41:31.475302 run osmo-hlr_10.42.42.2(pid=28104): Launched 04:41:31.711547 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:32.416808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Launched 04:41:32.719711 run osmo-stp_10.42.42.5(pid=28107): Launched 04:41:32.834478 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:33.379471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28109): Launched 04:41:33.681709 run osmo-msc_10.42.42.6(pid=28110): Launched 04:41:33.848816 run osmo-stp_10.42.42.5(pid=28107): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] 04:41:33.976530 run osmo-stp_10.42.42.5(pid=28107): stdout: | (launched: 2022-12-10_04:41:32.664116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:34.104759 run osmo-stp_10.42.42.5(pid=28107): stderr: | 20221210044132834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044132834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044132834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044132835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044132835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044132835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044132835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:34.231214 run osmo-stp_10.42.42.5(pid=28107): stdout: | (launched: 2022-12-10_04:41:32.664116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:34.351349 run osmo-stp_10.42.42.5(pid=28107): stderr: | 20221210044132834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044132834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044132834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044132835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044132835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044132835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044132835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:34.494864 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28107): Process ended prematurely: osmo-stp_10.42.42.5(pid=28107) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:41:34.503944 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:41:34.530815 run osmo-hlr_10.42.42.2(pid=28104): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28104)] 04:41:34.578075 run osmo-hlr_10.42.42.2(pid=28104): stdout: | (launched: 2022-12-10_04:41:31.413646) 04:41:34.627035 run osmo-hlr_10.42.42.2(pid=28104): stderr: | 20221210044131748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044131748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044131748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044131748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044131748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044131748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044131779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044131792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044131792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044131792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:34.695539 run osmo-msc_10.42.42.6(pid=28110): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28110)] 04:41:34.742832 run osmo-msc_10.42.42.6(pid=28110): stdout: | (launched: 2022-12-10_04:41:33.626048) 04:41:34.791634 run osmo-msc_10.42.42.6(pid=28110): stderr: | 20221210044133899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044133899 DLGLOBAL DEBUG validating counter group 0x7f9e7ac4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044133899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044133899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044133900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044133900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044133902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044133902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044133902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044133902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:34.841007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Terminating (SIGTERM) 04:41:34.880839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Terminating (SIGTERM) 04:41:34.920603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28109): Terminating (SIGTERM) 04:41:34.960407 --- ParallelTerminationStrategy: PID 28103 died... 04:41:34.979439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Terminated: ok {rc=0} 04:41:35.023384 --- ParallelTerminationStrategy: PID 28106 died... 04:41:35.041991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Terminated: ok {rc=0} 04:41:35.085809 --- ParallelTerminationStrategy: PID 28109 died... 04:41:35.104234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28109): Terminated: ok {rc=0} 04:41:35.190345 bus /sierra_3: Setting Powered False 04:41:36.290383 bus /sierra_3: Setting Powered False 04:41:37.404998 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:41:38.649743 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:38.656864 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:41:38.689850 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:41:38.716505 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:41:38.767691 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:41:38.799635 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:41:38.826214 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:41:39.378703 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:41:39.427391 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:39.438572 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:41:39.504392 tst mo_mt_call.py: using LAC 26062 04:41:39.626466 tst mo_mt_call.py: using RAC 52 04:41:39.743179 tst mo_mt_call.py: using CellId 26062 04:41:39.859506 tst mo_mt_call.py: using BVCI 26063 04:41:39.969156 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:39.980584 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:39.991682 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:40.002940 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:40.014210 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:40.025562 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:41:40.143454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:41:40.258289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:40.727086 run create_hlr_db(pid=28115): Launched 04:41:40.841733 bus /sierra_2: Setting Powered False 04:41:41.902081 run create_hlr_db(pid=28115): Terminated: ok {rc=0} 04:41:42.335965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28117): Launched 04:41:42.638917 run osmo-hlr_10.42.42.2(pid=28118): Launched 04:41:42.754240 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:43.272650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28120): Launched 04:41:43.574608 run osmo-stp_10.42.42.5(pid=28121): Launched 04:41:43.689631 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:44.233918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28123): Launched 04:41:44.534598 run osmo-msc_10.42.42.6(pid=28124): Launched 04:41:44.702822 run osmo-stp_10.42.42.5(pid=28121): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28121)] 04:41:44.830377 run osmo-stp_10.42.42.5(pid=28121): stdout: | (launched: 2022-12-10_04:41:43.518276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:44.958055 run osmo-stp_10.42.42.5(pid=28121): stderr: | 20221210044143692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044143692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044143692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044143692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044143693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044143693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044143693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:45.083373 run osmo-stp_10.42.42.5(pid=28121): stdout: | (launched: 2022-12-10_04:41:43.518276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:45.203015 run osmo-stp_10.42.42.5(pid=28121): stderr: | 20221210044143692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044143692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044143692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044143692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044143693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044143693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044143693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:45.346549 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28121): Process ended prematurely: osmo-stp_10.42.42.5(pid=28121) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28121)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:41:45.355488 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:41:45.382427 run osmo-hlr_10.42.42.2(pid=28118): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28118)] 04:41:45.430178 run osmo-hlr_10.42.42.2(pid=28118): stdout: | (launched: 2022-12-10_04:41:42.582825) 04:41:45.479316 run osmo-hlr_10.42.42.2(pid=28118): stderr: | 20221210044142759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044142759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044142759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044142759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044142759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044142760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044142775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044142785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044142786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044142786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:45.548410 run osmo-msc_10.42.42.6(pid=28124): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28124)] 04:41:45.596524 run osmo-msc_10.42.42.6(pid=28124): stdout: | (launched: 2022-12-10_04:41:44.478986) 04:41:45.645575 run osmo-msc_10.42.42.6(pid=28124): stderr: | 20221210044144751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044144751 DLGLOBAL DEBUG validating counter group 0x7f853972cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044144751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044144751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044144751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044144751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044144753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044144754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044144754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044144754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:45.695128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28117): Terminating (SIGTERM) 04:41:45.734542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28120): Terminating (SIGTERM) 04:41:45.773925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28123): Terminating (SIGTERM) 04:41:45.813860 --- ParallelTerminationStrategy: PID 28117 died... 04:41:45.833132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28117): Terminated: ok {rc=0} 04:41:45.877745 --- ParallelTerminationStrategy: PID 28120 died... 04:41:45.897026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28120): Terminated: ok {rc=0} 04:41:45.942616 --- ParallelTerminationStrategy: PID 28123 died... 04:41:45.961780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28123): Terminated: ok {rc=0} 04:41:46.054491 bus /sierra_3: Setting Powered False 04:41:47.149157 bus /sierra_3: Setting Powered False 04:41:48.262427 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:41:49.411600 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:49.424129 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:41:49.493592 tst mo_mt_call_osmux.py: using LAC 26063 04:41:49.612856 tst mo_mt_call_osmux.py: using RAC 53 04:41:49.730680 tst mo_mt_call_osmux.py: using CellId 26063 04:41:49.850991 tst mo_mt_call_osmux.py: using BVCI 26064 04:41:49.961474 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:49.972677 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:49.983709 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:49.994958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:50.006397 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:41:50.017736 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:41:50.132128 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:41:50.255567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:50.754397 run create_hlr_db(pid=28126): Launched 04:41:50.884711 bus /sierra_2: Setting Powered False 04:41:51.947923 run create_hlr_db(pid=28126): Terminated: ok {rc=0} 04:41:52.396187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28128): Launched 04:41:52.718339 run osmo-hlr_10.42.42.2(pid=28129): Launched 04:41:52.840247 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:53.395129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28131): Launched 04:41:53.716634 run osmo-stp_10.42.42.5(pid=28132): Launched 04:41:53.838974 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:54.420410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28134): Launched 04:41:54.742729 run osmo-msc_10.42.42.6(pid=28135): Launched 04:41:54.921180 run osmo-stp_10.42.42.5(pid=28132): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28132)] 04:41:55.057309 run osmo-stp_10.42.42.5(pid=28132): stdout: | (launched: 2022-12-10_04:41:53.657837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:55.192841 run osmo-stp_10.42.42.5(pid=28132): stderr: | 20221210044153850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044153850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044153850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044153851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044153851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044153851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044153851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:55.327860 run osmo-stp_10.42.42.5(pid=28132): stdout: | (launched: 2022-12-10_04:41:53.657837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:55.455730 run osmo-stp_10.42.42.5(pid=28132): stderr: | 20221210044153850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044153850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044153850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044153851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044153851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044153851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044153851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:55.609210 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28132): Process ended prematurely: osmo-stp_10.42.42.5(pid=28132) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28132)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:41:55.619260 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:41:55.647347 run osmo-hlr_10.42.42.2(pid=28129): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28129)] 04:41:55.696848 run osmo-hlr_10.42.42.2(pid=28129): stdout: | (launched: 2022-12-10_04:41:52.659593) 04:41:55.747910 run osmo-hlr_10.42.42.2(pid=28129): stderr: | 20221210044152859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044152859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044152859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044152859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044152859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044152859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044152872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044152880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044152881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044152881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:55.819578 run osmo-msc_10.42.42.6(pid=28135): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28135)] 04:41:55.868760 run osmo-msc_10.42.42.6(pid=28135): stdout: | (launched: 2022-12-10_04:41:54.683643) 04:41:55.919572 run osmo-msc_10.42.42.6(pid=28135): stderr: | 20221210044155006 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044155007 DLGLOBAL DEBUG validating counter group 0x7f1e45e94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044155007 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044155007 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044155007 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044155007 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044155009 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044155009 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044155010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044155010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:55.970634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28128): Terminating (SIGTERM) 04:41:56.012064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28131): Terminating (SIGTERM) 04:41:56.053426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28134): Terminating (SIGTERM) 04:41:56.095091 --- ParallelTerminationStrategy: PID 28128 died... 04:41:56.115068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28128): Terminated: ok {rc=0} 04:41:56.161147 --- ParallelTerminationStrategy: PID 28131 died... 04:41:56.180665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28131): Terminated: ok {rc=0} 04:41:56.226358 --- ParallelTerminationStrategy: PID 28134 died... 04:41:56.245827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28134): Terminated: ok {rc=0} 04:41:56.332108 bus /sierra_3: Setting Powered False 04:41:57.430340 bus /sierra_3: Setting Powered False 04:41:58.546350 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:41:59.791519 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:59.799113 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:41:59.832256 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:41:59.859080 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:41:59.911501 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:41:59.944412 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:41:59.970764 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:42:00.520254 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:42:00.569182 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:00.580757 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:42:00.646662 tst mo_mt_call.py: using LAC 26064 04:42:00.764059 tst mo_mt_call.py: using RAC 54 04:42:00.899333 tst mo_mt_call.py: using CellId 26064 04:42:01.058881 tst mo_mt_call.py: using BVCI 26065 04:42:01.173479 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:01.185322 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:01.196849 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:01.209196 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:01.222395 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:01.234007 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:42:01.351919 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:42:01.468793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:01.946818 run create_hlr_db(pid=28142): Launched 04:42:02.097829 bus /sierra_2: Setting Powered False 04:42:03.158338 run create_hlr_db(pid=28142): Terminated: ok {rc=0} 04:42:03.577877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28144): Launched 04:42:03.879336 run osmo-hlr_10.42.42.2(pid=28145): Launched 04:42:03.994767 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:04.528131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28147): Launched 04:42:04.830441 run osmo-stp_10.42.42.5(pid=28148): Launched 04:42:04.945126 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:05.491474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28150): Launched 04:42:05.793257 run osmo-msc_10.42.42.6(pid=28151): Launched 04:42:05.961506 run osmo-stp_10.42.42.5(pid=28148): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28148)] 04:42:06.089871 run osmo-stp_10.42.42.5(pid=28148): stdout: | (launched: 2022-12-10_04:42:04.774358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:06.218389 run osmo-stp_10.42.42.5(pid=28148): stderr: | 20221210044204944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044204945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044204945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044204945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044204946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044204946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044204946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:06.344038 run osmo-stp_10.42.42.5(pid=28148): stdout: | (launched: 2022-12-10_04:42:04.774358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:06.463468 run osmo-stp_10.42.42.5(pid=28148): stderr: | 20221210044204944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044204945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044204945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044204945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044204946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044204946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044204946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:06.606908 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28148): Process ended prematurely: osmo-stp_10.42.42.5(pid=28148) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28148)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:42:06.615843 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:42:06.642988 run osmo-hlr_10.42.42.2(pid=28145): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28145)] 04:42:06.690492 run osmo-hlr_10.42.42.2(pid=28145): stdout: | (launched: 2022-12-10_04:42:03.823927) 04:42:06.739515 run osmo-hlr_10.42.42.2(pid=28145): stderr: | 20221210044204000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044204000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044204000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044204000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044204000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044204001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044204013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044204022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044204022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044204022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:06.808356 run osmo-msc_10.42.42.6(pid=28151): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28151)] 04:42:06.855613 run osmo-msc_10.42.42.6(pid=28151): stdout: | (launched: 2022-12-10_04:42:05.737206) 04:42:06.904698 run osmo-msc_10.42.42.6(pid=28151): stderr: | 20221210044206009 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044206009 DLGLOBAL DEBUG validating counter group 0x7fe0428aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044206009 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044206009 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044206010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044206010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044206013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044206014 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044206014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044206014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:06.954033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28144): Terminating (SIGTERM) 04:42:06.993375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28147): Terminating (SIGTERM) 04:42:07.033015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28150): Terminating (SIGTERM) 04:42:07.072928 --- ParallelTerminationStrategy: PID 28144 died... 04:42:07.091874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28144): Terminated: ok {rc=0} 04:42:07.136270 --- ParallelTerminationStrategy: PID 28147 died... 04:42:07.154975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28147): Terminated: ok {rc=0} 04:42:07.198853 --- ParallelTerminationStrategy: PID 28150 died... 04:42:07.217287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28150): Terminated: ok {rc=0} 04:42:07.300299 bus /sierra_3: Setting Powered False 04:42:08.394942 bus /sierra_3: Setting Powered False 04:42:09.508281 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:42:10.652181 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:10.663893 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:42:10.734450 tst mo_mt_call_osmux.py: using LAC 26065 04:42:10.851939 tst mo_mt_call_osmux.py: using RAC 55 04:42:10.968119 tst mo_mt_call_osmux.py: using CellId 26065 04:42:11.087711 tst mo_mt_call_osmux.py: using BVCI 26066 04:42:11.198935 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:11.210194 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:11.221428 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:11.232529 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:11.243882 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:11.255045 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:42:11.368139 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:42:11.482646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:11.949331 run create_hlr_db(pid=28153): Launched 04:42:12.064214 bus /sierra_2: Setting Powered False 04:42:13.125099 run create_hlr_db(pid=28153): Terminated: ok {rc=0} 04:42:13.564630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28155): Launched 04:42:13.885980 run osmo-hlr_10.42.42.2(pid=28156): Launched 04:42:14.007812 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:14.565646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28158): Launched 04:42:14.887796 run osmo-stp_10.42.42.5(pid=28159): Launched 04:42:15.009838 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:15.591086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28161): Launched 04:42:15.940626 run osmo-msc_10.42.42.6(pid=28162): Launched 04:42:16.273172 run osmo-stp_10.42.42.5(pid=28159): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28159)] 04:42:16.560095 run osmo-stp_10.42.42.5(pid=28159): stdout: | (launched: 2022-12-10_04:42:14.828678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:16.751589 run osmo-stp_10.42.42.5(pid=28159): stderr: | 20221210044215021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044215021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044215022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044215022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044215023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044215023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044215023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:16.882747 run osmo-stp_10.42.42.5(pid=28159): stdout: | (launched: 2022-12-10_04:42:14.828678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:17.007284 run osmo-stp_10.42.42.5(pid=28159): stderr: | 20221210044215021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044215021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044215022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044215022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044215023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044215023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044215023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:17.156291 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28159): Process ended prematurely: osmo-stp_10.42.42.5(pid=28159) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28159)] [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:42:17.166638 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:42:17.197913 run osmo-hlr_10.42.42.2(pid=28156): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28156)] 04:42:17.247846 run osmo-hlr_10.42.42.2(pid=28156): stdout: | (launched: 2022-12-10_04:42:13.827192) 04:42:17.299551 run osmo-hlr_10.42.42.2(pid=28156): stderr: | 20221210044214027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044214027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044214027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044214027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044214027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044214028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044214043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044214053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044214053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044214053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:17.374109 run osmo-msc_10.42.42.6(pid=28162): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28162)] 04:42:17.423631 run osmo-msc_10.42.42.6(pid=28162): stdout: | (launched: 2022-12-10_04:42:15.871709) 04:42:17.474365 run osmo-msc_10.42.42.6(pid=28162): stderr: | 20221210044216352 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044216353 DLGLOBAL DEBUG validating counter group 0x7fd453a56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044216353 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044216353 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044216353 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044216353 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044216355 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044216355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044216355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044216355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:17.524022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28155): Terminating (SIGTERM) 04:42:17.564527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28158): Terminating (SIGTERM) 04:42:17.604207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28161): Terminating (SIGTERM) 04:42:17.644163 --- ParallelTerminationStrategy: PID 28155 died... 04:42:17.663132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28155): Terminated: ok {rc=0} 04:42:17.707652 --- ParallelTerminationStrategy: PID 28158 died... 04:42:17.726286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28158): Terminated: ok {rc=0} 04:42:17.770415 --- ParallelTerminationStrategy: PID 28161 died... 04:42:17.789051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28161): Terminated: ok {rc=0} 04:42:17.872718 bus /sierra_3: Setting Powered False 04:42:18.970092 bus /sierra_3: Setting Powered False 04:42:20.085723 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:42:21.342497 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:21.350762 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:42:21.384209 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:42:21.411771 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:42:21.466173 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:42:21.499532 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:42:21.526747 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:42:22.079228 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:42:22.132500 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:22.144501 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:42:22.213738 tst mo_mt_call.py: using LAC 26066 04:42:22.340557 tst mo_mt_call.py: using RAC 56 04:42:22.465811 tst mo_mt_call.py: using CellId 26066 04:42:22.590478 tst mo_mt_call.py: using BVCI 26067 04:42:22.707100 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:22.718926 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:22.730578 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:22.742154 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:22.753848 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:22.765431 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:42:22.882232 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:42:23.003537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:23.502742 run create_hlr_db(pid=28167): Launched 04:42:23.632710 bus /sierra_2: Setting Powered False 04:42:24.697094 run create_hlr_db(pid=28167): Terminated: ok {rc=0} 04:42:25.128656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28169): Launched 04:42:25.432639 run osmo-hlr_10.42.42.2(pid=28170): Launched 04:42:25.548421 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:26.082819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28172): Launched 04:42:26.385013 run osmo-stp_10.42.42.5(pid=28173): Launched 04:42:26.499661 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:27.045276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28175): Launched 04:42:27.350025 run osmo-msc_10.42.42.6(pid=28176): Launched 04:42:27.518579 run osmo-stp_10.42.42.5(pid=28173): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28173)] 04:42:27.647722 run osmo-stp_10.42.42.5(pid=28173): stdout: | (launched: 2022-12-10_04:42:26.328851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:27.777309 run osmo-stp_10.42.42.5(pid=28173): stderr: | 20221210044226501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044226501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044226501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044226502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044226502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044226502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044226502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:27.902979 run osmo-stp_10.42.42.5(pid=28173): stdout: | (launched: 2022-12-10_04:42:26.328851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:28.023165 run osmo-stp_10.42.42.5(pid=28173): stderr: | 20221210044226501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044226501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044226501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044226502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044226502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044226502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044226502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:28.166916 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28173): Process ended prematurely: osmo-stp_10.42.42.5(pid=28173) [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28173)] [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:42:28.175998 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:42:28.202923 run osmo-hlr_10.42.42.2(pid=28170): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28170)] 04:42:28.250509 run osmo-hlr_10.42.42.2(pid=28170): stdout: | (launched: 2022-12-10_04:42:25.376684) 04:42:28.299742 run osmo-hlr_10.42.42.2(pid=28170): stderr: | 20221210044225553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044225553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044225554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044225554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044225554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044225554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044225565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044225575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044225575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044225575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:28.368372 run osmo-msc_10.42.42.6(pid=28176): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28176)] 04:42:28.415941 run osmo-msc_10.42.42.6(pid=28176): stdout: | (launched: 2022-12-10_04:42:27.292554) 04:42:28.465168 run osmo-msc_10.42.42.6(pid=28176): stderr: | 20221210044227567 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044227567 DLGLOBAL DEBUG validating counter group 0x7ff882ad6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044227568 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044227568 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044227568 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044227569 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044227571 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044227572 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044227572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044227572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:28.514691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28169): Terminating (SIGTERM) 04:42:28.554372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28172): Terminating (SIGTERM) 04:42:28.593865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28175): Terminating (SIGTERM) 04:42:28.633698 --- ParallelTerminationStrategy: PID 28169 died... 04:42:28.652660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28169): Terminated: ok {rc=0} 04:42:28.696805 --- ParallelTerminationStrategy: PID 28172 died... 04:42:28.715723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28172): Terminated: ok {rc=0} 04:42:28.759559 --- ParallelTerminationStrategy: PID 28175 died... 04:42:28.778061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28175): Terminated: ok {rc=0} 04:42:28.863615 bus /sierra_3: Setting Powered False 04:42:29.962419 bus /sierra_3: Setting Powered False 04:42:31.082995 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:42:32.240545 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:32.253727 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:42:32.322138 tst mo_mt_call_osmux.py: using LAC 26067 04:42:32.440193 tst mo_mt_call_osmux.py: using RAC 57 04:42:32.562972 tst mo_mt_call_osmux.py: using CellId 26067 04:42:32.690302 tst mo_mt_call_osmux.py: using BVCI 26068 04:42:32.809511 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:32.821526 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:32.833385 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:32.845695 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:32.857930 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:42:32.870156 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:42:32.991633 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:42:33.109341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:33.579452 run create_hlr_db(pid=28178): Launched 04:42:33.695042 bus /sierra_2: Setting Powered False 04:42:34.755280 run create_hlr_db(pid=28178): Terminated: ok {rc=0} 04:42:35.195212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28180): Launched 04:42:35.517938 run osmo-hlr_10.42.42.2(pid=28181): Launched 04:42:35.641700 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:36.196881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28183): Launched 04:42:36.517654 run osmo-stp_10.42.42.5(pid=28184): Launched 04:42:36.640406 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:37.219825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28186): Launched 04:42:37.541303 run osmo-msc_10.42.42.6(pid=28187): Launched 04:42:37.713398 run osmo-stp_10.42.42.5(pid=28184): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28184)] 04:42:37.843386 run osmo-stp_10.42.42.5(pid=28184): stdout: | (launched: 2022-12-10_04:42:36.458867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:37.971104 run osmo-stp_10.42.42.5(pid=28184): stderr: | 20221210044236650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044236651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044236651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044236651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044236652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044236652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044236652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:38.096828 run osmo-stp_10.42.42.5(pid=28184): stdout: | (launched: 2022-12-10_04:42:36.458867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:38.216704 run osmo-stp_10.42.42.5(pid=28184): stderr: | 20221210044236650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044236651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044236651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044236651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044236652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044236652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044236652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:38.360463 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28184): Process ended prematurely: osmo-stp_10.42.42.5(pid=28184) [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28184)] [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:42:38.369610 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:42:38.396588 run osmo-hlr_10.42.42.2(pid=28181): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28181)] 04:42:38.444267 run osmo-hlr_10.42.42.2(pid=28181): stdout: | (launched: 2022-12-10_04:42:35.459437) 04:42:38.493748 run osmo-hlr_10.42.42.2(pid=28181): stderr: | 20221210044235657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044235657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044235657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044235657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044235657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044235657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044235669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044235677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044235677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044235677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:38.562898 run osmo-msc_10.42.42.6(pid=28187): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28187)] 04:42:38.610531 run osmo-msc_10.42.42.6(pid=28187): stdout: | (launched: 2022-12-10_04:42:37.484092) 04:42:38.659816 run osmo-msc_10.42.42.6(pid=28187): stderr: | 20221210044237754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044237754 DLGLOBAL DEBUG validating counter group 0x7fc0a91d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044237754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044237754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044237754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044237754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044237756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044237756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044237757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044237757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:38.709599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28180): Terminating (SIGTERM) 04:42:38.749320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28183): Terminating (SIGTERM) 04:42:38.789778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28186): Terminating (SIGTERM) 04:42:38.830393 --- ParallelTerminationStrategy: PID 28180 died... 04:42:38.849494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28180): Terminated: ok {rc=0} 04:42:38.893807 --- ParallelTerminationStrategy: PID 28183 died... 04:42:38.912233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28183): Terminated: ok {rc=0} 04:42:38.956503 --- ParallelTerminationStrategy: PID 28186 died... 04:42:38.975196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28186): Terminated: ok {rc=0} 04:42:39.059519 bus /sierra_3: Setting Powered False 04:42:40.157281 bus /sierra_3: Setting Powered False 04:42:41.273053 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:42:42.528473 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:42.536062 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:42:42.568935 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 04:42:42.596754 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 04:42:42.649385 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:42:42.682648 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 04:42:42.709935 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 04:42:43.265617 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 04:42:43.316887 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:43.328763 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:42:43.379339 tst mo_mt_call.py: using LAC 26068 04:42:43.506484 tst mo_mt_call.py: using RAC 58 04:42:43.631267 tst mo_mt_call.py: using CellId 26068 04:42:43.750797 tst mo_mt_call.py: using BVCI 26069 04:42:43.861532 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:43.873149 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:43.884424 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:43.896184 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:43.908072 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:43.920041 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:42:44.040501 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:42:44.156629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:44.625154 run create_hlr_db(pid=28192): Launched 04:42:44.740786 bus /sierra_2: Setting Powered False 04:42:45.801652 run create_hlr_db(pid=28192): Terminated: ok {rc=0} 04:42:46.242354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28194): Launched 04:42:46.574476 run osmo-hlr_10.42.42.2(pid=28195): Launched 04:42:46.810931 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:47.472924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28197): Launched 04:42:47.796069 run osmo-stp_10.42.42.5(pid=28198): Launched 04:42:47.918060 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:48.498922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28200): Launched 04:42:48.820296 run osmo-msc_10.42.42.6(pid=28201): Launched 04:42:48.999144 run osmo-stp_10.42.42.5(pid=28198): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28198)] 04:42:49.134654 run osmo-stp_10.42.42.5(pid=28198): stdout: | (launched: 2022-12-10_04:42:47.737309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:49.270663 run osmo-stp_10.42.42.5(pid=28198): stderr: | 20221210044247929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044247929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044247929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044247930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044247932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044247932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044247932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:49.405202 run osmo-stp_10.42.42.5(pid=28198): stdout: | (launched: 2022-12-10_04:42:47.737309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:49.533265 run osmo-stp_10.42.42.5(pid=28198): stderr: | 20221210044247929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044247929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044247929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044247930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044247932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044247932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044247932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:49.686614 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28198): Process ended prematurely: osmo-stp_10.42.42.5(pid=28198) [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28198)] [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 04:42:49.696345 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:42:49.724477 run osmo-hlr_10.42.42.2(pid=28195): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28195)] 04:42:49.774454 run osmo-hlr_10.42.42.2(pid=28195): stdout: | (launched: 2022-12-10_04:42:46.505990) 04:42:49.826120 run osmo-hlr_10.42.42.2(pid=28195): stderr: | 20221210044246813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044246814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044246814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044246814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044246814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044246814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044246827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044246843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044246843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044246843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:49.898066 run osmo-msc_10.42.42.6(pid=28201): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28201)] 04:42:49.947806 run osmo-msc_10.42.42.6(pid=28201): stdout: | (launched: 2022-12-10_04:42:48.761435) 04:42:49.999379 run osmo-msc_10.42.42.6(pid=28201): stderr: | 20221210044249082 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044249083 DLGLOBAL DEBUG validating counter group 0x7f593de23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044249083 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044249083 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044249083 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044249083 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044249085 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044249085 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044249085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044249086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:50.051319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28194): Terminating (SIGTERM) 04:42:50.093085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28197): Terminating (SIGTERM) 04:42:50.134916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28200): Terminating (SIGTERM) 04:42:50.176763 --- ParallelTerminationStrategy: PID 28194 died... 04:42:50.196744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28194): Terminated: ok {rc=0} 04:42:50.243283 --- ParallelTerminationStrategy: PID 28197 died... 04:42:50.262786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28197): Terminated: ok {rc=0} 04:42:50.308535 --- ParallelTerminationStrategy: PID 28200 died... 04:42:50.328007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28200): Terminated: ok {rc=0} 04:42:50.415242 bus /sierra_3: Setting Powered False 04:42:51.514383 bus /sierra_3: Setting Powered False 04:42:52.629857 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 04:42:53.775820 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:53.787750 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:42:53.838213 tst mo_mt_call_osmux.py: using LAC 26069 04:42:53.957586 tst mo_mt_call_osmux.py: using RAC 59 04:42:54.077636 tst mo_mt_call_osmux.py: using CellId 26069 04:42:54.196934 tst mo_mt_call_osmux.py: using BVCI 26070 04:42:54.305715 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:54.317111 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:54.328325 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:54.339800 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:54.351536 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:42:54.362945 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:42:54.477619 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:42:54.596428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:55.094761 run create_hlr_db(pid=28203): Launched 04:42:55.224888 bus /sierra_2: Setting Powered False 04:42:56.288670 run create_hlr_db(pid=28203): Terminated: ok {rc=0} 04:42:56.720011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28205): Launched 04:42:57.022263 run osmo-hlr_10.42.42.2(pid=28206): Launched 04:42:57.137577 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:57.671385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28208): Launched 04:42:57.975169 run osmo-stp_10.42.42.5(pid=28209): Launched 04:42:58.090527 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:58.635770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28211): Launched 04:42:58.938235 run osmo-msc_10.42.42.6(pid=28212): Launched 04:42:59.107118 run osmo-stp_10.42.42.5(pid=28209): ERR: Terminated: ERROR {rc=1} [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28209)] 04:42:59.234733 run osmo-stp_10.42.42.5(pid=28209): stdout: | (launched: 2022-12-10_04:42:57.918395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:59.362827 run osmo-stp_10.42.42.5(pid=28209): stderr: | 20221210044258088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044258088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044258088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044258089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044258089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044258089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044258089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:59.489075 run osmo-stp_10.42.42.5(pid=28209): stdout: | (launched: 2022-12-10_04:42:57.918395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:59.609546 run osmo-stp_10.42.42.5(pid=28209): stderr: | 20221210044258088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044258088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044258088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044258089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044258089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044258089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044258089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:59.753777 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28209): Process ended prematurely: osmo-stp_10.42.42.5(pid=28209) [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28209)] [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 04:42:59.763034 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:42:59.790631 run osmo-hlr_10.42.42.2(pid=28206): ERR: Terminated: ERROR {rc=237} [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28206)] 04:42:59.838506 run osmo-hlr_10.42.42.2(pid=28206): stdout: | (launched: 2022-12-10_04:42:56.966637) 04:42:59.887848 run osmo-hlr_10.42.42.2(pid=28206): stderr: | 20221210044257142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044257142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044257142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044257142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044257142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044257142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044257154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044257162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044257163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044257163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:59.956512 run osmo-msc_10.42.42.6(pid=28212): ERR: Terminated: ERROR {rc=2} [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28212)] 04:43:00.004340 run osmo-msc_10.42.42.6(pid=28212): stdout: | (launched: 2022-12-10_04:42:58.882228) 04:43:00.053590 run osmo-msc_10.42.42.6(pid=28212): stderr: | 20221210044259154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044259154 DLGLOBAL DEBUG validating counter group 0x7f66d625ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044259154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044259154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044259154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044259155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044259157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044259157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044259157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044259157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:00.103454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28205): Terminating (SIGTERM) 04:43:00.143313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28208): Terminating (SIGTERM) 04:43:00.183074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28211): Terminating (SIGTERM) 04:43:00.223106 --- ParallelTerminationStrategy: PID 28205 died... 04:43:00.242200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28205): Terminated: ok {rc=0} 04:43:00.287134 --- ParallelTerminationStrategy: PID 28208 died... 04:43:00.306001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28208): Terminated: ok {rc=0} 04:43:00.350673 --- ParallelTerminationStrategy: PID 28211 died... 04:43:00.369582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28211): Terminated: ok {rc=0} 04:43:00.455330 bus /sierra_3: Setting Powered False 04:43:01.556790 bus /sierra_3: Setting Powered False 04:43:02.674837 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 emergency:nanobts+band-900 --------------------------------------------------------------------- 04:43:03.925809 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:43:03.931218 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:43:03.964322 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:43:03.991232 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 04:43:04.073131 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:43:04.105065 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:43:04.131158 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 04:43:04.717823 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2369 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 04:43:04.723123 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:04.734019 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 04:43:04.781779 tst emergency_mo_mt_call.py: using LAC 26070 04:43:04.898660 tst emergency_mo_mt_call.py: using RAC 60 04:43:05.015399 tst emergency_mo_mt_call.py: using CellId 26070 04:43:05.129363 tst emergency_mo_mt_call.py: using BVCI 26071 04:43:05.236013 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:05.246869 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:05.257469 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:05.268441 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:05.279446 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:05.290642 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:05.402486 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:05.520295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:05.981031 run create_hlr_db(pid=28217): Launched 04:43:06.094538 bus /sierra_2: Setting Powered False 04:43:07.154450 run create_hlr_db(pid=28217): Terminated: ok {rc=0} 04:43:07.588165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28219): Launched 04:43:07.904680 run osmo-hlr_10.42.42.2(pid=28220): Launched 04:43:08.024455 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:08.568915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28222): Launched 04:43:08.884886 run osmo-stp_10.42.42.5(pid=28223): Launched 04:43:09.015407 tst emergency_mo_mt_call.py: using MSISDN 7553 04:43:09.177253 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:09.747667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28225): Launched 04:43:10.063379 run osmo-msc_10.42.42.6(pid=28226): Launched 04:43:10.239510 run osmo-stp_10.42.42.5(pid=28223): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28223)] 04:43:10.377046 run osmo-stp_10.42.42.5(pid=28223): stdout: | (launched: 2022-12-10_04:43:08.826812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:10.510885 run osmo-stp_10.42.42.5(pid=28223): stderr: | 20221210044309018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044309019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044309019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044309019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044309020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044309020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044309020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:10.643937 run osmo-stp_10.42.42.5(pid=28223): stdout: | (launched: 2022-12-10_04:43:08.826812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:10.769952 run osmo-stp_10.42.42.5(pid=28223): stderr: | 20221210044309018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044309019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044309019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044309019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044309020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044309020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044309020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:10.920561 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28223): Process ended prematurely: osmo-stp_10.42.42.5(pid=28223) [trial-2369↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28223)] [trial-2369↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 04:43:10.929750 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 04:43:10.957244 run osmo-hlr_10.42.42.2(pid=28220): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28220)] 04:43:11.007264 run osmo-hlr_10.42.42.2(pid=28220): stdout: | (launched: 2022-12-10_04:43:07.846838) 04:43:11.059101 run osmo-hlr_10.42.42.2(pid=28220): stderr: | 20221210044308045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044308045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044308045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044308045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044308045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044308045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044308058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044308067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044308067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044308068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:11.131580 run osmo-msc_10.42.42.6(pid=28226): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28226)] 04:43:11.181689 run osmo-msc_10.42.42.6(pid=28226): stdout: | (launched: 2022-12-10_04:43:10.005229) 04:43:11.233423 run osmo-msc_10.42.42.6(pid=28226): stderr: | 20221210044310325 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044310325 DLGLOBAL DEBUG validating counter group 0x7fe1b2590c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044310325 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044310326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044310326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044310326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044310328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044310328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044310328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044310328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:11.285372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28219): Terminating (SIGTERM) 04:43:11.327308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28222): Terminating (SIGTERM) 04:43:11.369144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28225): Terminating (SIGTERM) 04:43:11.411143 --- ParallelTerminationStrategy: PID 28219 died... 04:43:11.431181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28219): Terminated: ok {rc=0} 04:43:11.477624 --- ParallelTerminationStrategy: PID 28222 died... 04:43:11.497225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28222): Terminated: ok {rc=0} 04:43:11.543075 --- ParallelTerminationStrategy: PID 28225 died... 04:43:11.562728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28225): Terminated: ok {rc=0} 04:43:11.649948 bus /sierra_3: Setting Powered False 04:43:12.747805 bus /sierra_3: Setting Powered False 04:43:13.864467 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 04:43:14.952297 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:14.963948 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 04:43:15.018575 tst emergency_preemptive_call.py: using LAC 26071 04:43:15.135564 tst emergency_preemptive_call.py: using RAC 61 04:43:15.251155 tst emergency_preemptive_call.py: using CellId 26071 04:43:15.365867 tst emergency_preemptive_call.py: using BVCI 26072 04:43:15.473475 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:15.484511 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:15.495409 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:15.506936 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:15.518459 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:43:15.531063 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:15.645385 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:15.760494 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:15.881756 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:16.012766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:16.540423 run create_hlr_db(pid=28228): Launched 04:43:16.690167 bus /sierra_2: Setting Powered False 04:43:17.754746 run create_hlr_db(pid=28228): Terminated: ok {rc=0} 04:43:18.181214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28230): Launched 04:43:18.479383 run osmo-hlr_10.42.42.2(pid=28231): Launched 04:43:18.593173 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:19.113890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28233): Launched 04:43:19.412332 run osmo-stp_10.42.42.5(pid=28234): Launched 04:43:19.536391 tst emergency_preemptive_call.py: using MSISDN 7554 04:43:19.691020 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:20.225295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28236): Launched 04:43:20.522838 run osmo-msc_10.42.42.6(pid=28237): Launched 04:43:20.691099 run osmo-stp_10.42.42.5(pid=28234): ERR: Terminated: ERROR {rc=1} [trial-2369↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28234)] 04:43:20.817972 run osmo-stp_10.42.42.5(pid=28234): stdout: | (launched: 2022-12-10_04:43:19.357386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:20.944642 run osmo-stp_10.42.42.5(pid=28234): stderr: | 20221210044319527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044319527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044319527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044319528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044319528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044319528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044319528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:21.069856 run osmo-stp_10.42.42.5(pid=28234): stdout: | (launched: 2022-12-10_04:43:19.357386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:21.188573 run osmo-stp_10.42.42.5(pid=28234): stderr: | 20221210044319527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044319527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044319527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044319528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044319528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044319528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044319528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:21.330824 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28234): Process ended prematurely: osmo-stp_10.42.42.5(pid=28234) [trial-2369↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28234)] [trial-2369↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 04:43:21.339460 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 04:43:21.366609 run osmo-hlr_10.42.42.2(pid=28231): ERR: Terminated: ERROR {rc=237} [trial-2369↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28231)] 04:43:21.414900 run osmo-hlr_10.42.42.2(pid=28231): stdout: | (launched: 2022-12-10_04:43:18.423931) 04:43:21.464697 run osmo-hlr_10.42.42.2(pid=28231): stderr: | 20221210044318598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044318598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044318598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044318598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044318598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044318598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044318610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044318620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044318620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044318620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:21.534719 run osmo-msc_10.42.42.6(pid=28237): ERR: Terminated: ERROR {rc=2} [trial-2369↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28237)] 04:43:21.582928 run osmo-msc_10.42.42.6(pid=28237): stdout: | (launched: 2022-12-10_04:43:20.467831) 04:43:21.632826 run osmo-msc_10.42.42.6(pid=28237): stderr: | 20221210044320737 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044320737 DLGLOBAL DEBUG validating counter group 0x7f5632d71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044320737 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044320737 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044320737 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044320737 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044320739 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044320740 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044320740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044320740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:21.683069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28230): Terminating (SIGTERM) 04:43:21.723570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28233): Terminating (SIGTERM) 04:43:21.764538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28236): Terminating (SIGTERM) 04:43:21.805318 --- ParallelTerminationStrategy: PID 28230 died... 04:43:21.824495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28230): Terminated: ok {rc=0} 04:43:21.870026 --- ParallelTerminationStrategy: PID 28233 died... 04:43:21.888926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28233): Terminated: ok {rc=0} 04:43:21.933646 --- ParallelTerminationStrategy: PID 28236 died... 04:43:21.952482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28236): Terminated: ok {rc=0} 04:43:22.039242 bus /sierra_9: Setting Powered False 04:43:23.140520 bus /sierra_9: Setting Powered False 04:43:24.257665 bus /sierra_8: Setting Powered False 04:43:25.356594 bus /sierra_8: Setting Powered False 04:43:26.474976 bus /sierra_3: Setting Powered False 04:43:27.574906 bus /sierra_3: Setting Powered False 04:43:28.689752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900 --------------------------------------------------------------------- 04:43:29.972350 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:43:29.978121 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:43:30.010843 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 04:43:30.050103 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 04:43:30.139102 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:43:30.171956 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 04:43:30.211261 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 04:43:30.805378 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 04:43:30.858147 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:30.872700 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:43:30.935767 tst cs_paging_gprs_active.py: using LAC 26072 04:43:31.065801 tst cs_paging_gprs_active.py: using RAC 62 04:43:31.196356 tst cs_paging_gprs_active.py: using CellId 26072 04:43:31.325347 tst cs_paging_gprs_active.py: using BVCI 26073 04:43:31.473476 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.485907 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.498407 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.510270 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.522168 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.534034 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.546461 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.558464 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:31.570435 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:31.687402 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:31.818168 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:43:32.047728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:43:32.377703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Launched 04:43:32.658562 run iperf3-srv_10.42.42.10(pid=28243): Launched 04:43:32.779125 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:43:32.997358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:43:33.321861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28244): Launched 04:43:33.601786 run iperf3-srv_10.42.42.10(pid=28245): Launched 04:43:33.722525 tst cs_paging_gprs_active.py:38: start network... 04:43:33.941034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:34.438611 run create_hlr_db(pid=28246): Launched 04:43:34.570192 bus /sierra_2: Setting Powered False 04:43:35.634020 run create_hlr_db(pid=28246): Terminated: ok {rc=0} 04:43:36.083777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28248): Launched 04:43:36.406389 run osmo-hlr_10.42.42.2(pid=28249): Launched 04:43:36.530558 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:37.086636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28251): Launched 04:43:37.407422 run osmo-stp_10.42.42.5(pid=28252): Launched 04:43:37.529850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:43:38.085211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28254): Launched 04:43:38.207281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:43:38.479123 run patchelf(pid=28255): Launched 04:43:38.657682 run osmo-stp_10.42.42.5(pid=28252): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28252)] 04:43:38.793583 run osmo-stp_10.42.42.5(pid=28252): stdout: | (launched: 2022-12-10_04:43:37.348427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:38.931517 run osmo-stp_10.42.42.5(pid=28252): stderr: | 20221210044337540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044337540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044337540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044337541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044337543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044337544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044337544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:39.069217 run osmo-stp_10.42.42.5(pid=28252): stdout: | (launched: 2022-12-10_04:43:37.348427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:39.200314 run osmo-stp_10.42.42.5(pid=28252): stderr: | 20221210044337540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044337540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044337540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044337541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044337543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044337544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044337544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:39.356054 run patchelf(pid=28255): Terminating (SIGINT) 04:43:39.536220 run patchelf(pid=28255): Terminated: ok {rc=0} 04:43:39.666775 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28252): Process ended prematurely: osmo-stp_10.42.42.5(pid=28252) [trial-2369↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28252)] [trial-2369↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 04:43:39.677171 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:43:39.705813 run osmo-hlr_10.42.42.2(pid=28249): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28249)] 04:43:39.755156 run osmo-hlr_10.42.42.2(pid=28249): stdout: | (launched: 2022-12-10_04:43:36.347045) 04:43:39.806318 run osmo-hlr_10.42.42.2(pid=28249): stderr: | 20221210044336546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044336546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044336547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044336547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044336547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044336547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044336559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044336568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044336568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044336568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:39.858070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Terminating (SIGTERM) 04:43:39.899733 run iperf3-srv_10.42.42.10(pid=28243): Terminating (SIGTERM) 04:43:39.941119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28244): Terminating (SIGTERM) 04:43:39.982473 run iperf3-srv_10.42.42.10(pid=28245): Terminating (SIGTERM) 04:43:40.023516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28248): Terminating (SIGTERM) 04:43:40.064749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28251): Terminating (SIGTERM) 04:43:40.106062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28254): Terminating (SIGTERM) 04:43:40.147642 --- ParallelTerminationStrategy: PID 28242 died... 04:43:40.167444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Terminated: ok {rc=0} 04:43:40.213516 --- ParallelTerminationStrategy: PID 28243 died... 04:43:40.232881 run iperf3-srv_10.42.42.10(pid=28243): Terminated {rc=256} 04:43:40.278265 --- ParallelTerminationStrategy: PID 28244 died... 04:43:40.297537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28244): Terminated: ok {rc=0} 04:43:40.342870 --- ParallelTerminationStrategy: PID 28245 died... 04:43:40.362086 run iperf3-srv_10.42.42.10(pid=28245): Terminated {rc=256} 04:43:40.407102 --- ParallelTerminationStrategy: PID 28248 died... 04:43:40.426347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28248): Terminated: ok {rc=0} 04:43:40.471619 --- ParallelTerminationStrategy: PID 28251 died... 04:43:40.490970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28251): Terminated: ok {rc=0} 04:43:40.536618 --- ParallelTerminationStrategy: PID 28254 died... 04:43:40.556118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28254): Terminated: ok {rc=0} 04:43:40.642286 bus /gobi_0: Setting Powered False 04:43:41.741590 bus /gobi_0: Setting Powered False 04:43:42.855560 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 04:43:44.003759 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.015476 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:43:44.066422 tst iperf3.py: using LAC 26073 04:43:44.194963 tst iperf3.py: using RAC 63 04:43:44.321287 tst iperf3.py: using CellId 26073 04:43:44.448368 tst iperf3.py: using BVCI 26074 04:43:44.565118 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.576333 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.587410 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.598423 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.609342 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.620217 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.631323 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.642284 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:44.653768 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:44.771117 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:43:44.990096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:43:45.314157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28256): Launched 04:43:45.595175 run iperf3-srv_10.42.42.10(pid=28257): Launched 04:43:45.716646 tst iperf3.py:8: start network... 04:43:45.938055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:46.456158 run create_hlr_db(pid=28258): Launched 04:43:46.614753 bus /gobi_6: Setting Powered False 04:43:47.675499 run create_hlr_db(pid=28258): Terminated: ok {rc=0} 04:43:48.129876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28260): Launched 04:43:48.452707 run osmo-hlr_10.42.42.2(pid=28261): Launched 04:43:48.575129 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:49.130635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28263): Launched 04:43:49.452734 run osmo-stp_10.42.42.5(pid=28264): Launched 04:43:49.575303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:43:50.132115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28266): Launched 04:43:50.254973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:43:50.527392 run patchelf(pid=28267): Launched 04:43:50.706252 run osmo-stp_10.42.42.5(pid=28264): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28264)] 04:43:50.842880 run osmo-stp_10.42.42.5(pid=28264): stdout: | (launched: 2022-12-10_04:43:49.393652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:50.980842 run osmo-stp_10.42.42.5(pid=28264): stderr: | 20221210044349587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044349587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044349588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044349588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044349588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044349588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044349589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:51.119005 run osmo-stp_10.42.42.5(pid=28264): stdout: | (launched: 2022-12-10_04:43:49.393652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:51.251150 run osmo-stp_10.42.42.5(pid=28264): stderr: | 20221210044349587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044349587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044349588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044349588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044349588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044349588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044349589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:51.407596 run patchelf(pid=28267): Terminating (SIGINT) 04:43:51.587764 run patchelf(pid=28267): Terminated: ok {rc=0} 04:43:51.718562 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28264): Process ended prematurely: osmo-stp_10.42.42.5(pid=28264) [trial-2369↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28264)] [trial-2369↪gprs:nanobts+band-900↪iperf3.py:8] 04:43:51.729165 tst iperf3.py:8: Test FAILED (7.8 sec) 04:43:51.757830 run osmo-hlr_10.42.42.2(pid=28261): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28261)] 04:43:51.807564 run osmo-hlr_10.42.42.2(pid=28261): stdout: | (launched: 2022-12-10_04:43:48.393407) 04:43:51.858863 run osmo-hlr_10.42.42.2(pid=28261): stderr: | 20221210044348593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044348593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044348593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044348593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044348593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044348593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044348606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044348614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044348614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044348614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:51.910623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28256): Terminating (SIGTERM) 04:43:51.952626 run iperf3-srv_10.42.42.10(pid=28257): Terminating (SIGTERM) 04:43:51.994728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28260): Terminating (SIGTERM) 04:43:52.036744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28263): Terminating (SIGTERM) 04:43:52.078583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28266): Terminating (SIGTERM) 04:43:52.120808 --- ParallelTerminationStrategy: PID 28256 died... 04:43:52.140910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28256): Terminated: ok {rc=0} 04:43:52.187749 --- ParallelTerminationStrategy: PID 28257 died... 04:43:52.207627 run iperf3-srv_10.42.42.10(pid=28257): Terminated {rc=256} 04:43:52.253851 --- ParallelTerminationStrategy: PID 28260 died... 04:43:52.273580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28260): Terminated: ok {rc=0} 04:43:52.319803 --- ParallelTerminationStrategy: PID 28263 died... 04:43:52.339650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28263): Terminated: ok {rc=0} 04:43:52.386099 --- ParallelTerminationStrategy: PID 28266 died... 04:43:52.405929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28266): Terminated: ok {rc=0} 04:43:52.493627 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 04:43:53.639942 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:53.651316 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:43:53.698656 tst iperf3m4.py: using LAC 26074 04:43:53.817659 tst iperf3m4.py: using RAC 64 04:43:53.939083 tst iperf3m4.py: using CellId 26074 04:43:54.061399 tst iperf3m4.py: using BVCI 26075 04:43:54.171658 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.182486 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.193062 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.204355 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.215458 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.226702 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.238194 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.249350 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:43:54.260830 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:54.378182 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:54.501147 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:54.617884 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:43:54.732682 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:43:54.938333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:43:55.244797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28268): Launched 04:43:55.510323 run iperf3-srv_10.42.42.10(pid=28269): Launched 04:43:55.624601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:43:55.828434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:43:56.133505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28270): Launched 04:43:56.397262 run iperf3-srv_10.42.42.10(pid=28271): Launched 04:43:56.511121 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:43:56.715477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:43:57.020857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28272): Launched 04:43:57.285558 run iperf3-srv_10.42.42.10(pid=28273): Launched 04:43:57.398950 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:43:57.602070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:43:57.906751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28274): Launched 04:43:58.172694 run iperf3-srv_10.42.42.10(pid=28275): Launched 04:43:58.285979 tst iperf3m4.py:8: start network... 04:43:58.488827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:58.958116 run create_hlr_db(pid=28276): Launched 04:43:59.073501 bus /gobi_6: Setting Powered False 04:44:00.134300 run create_hlr_db(pid=28276): Terminated: ok {rc=0} 04:44:00.558022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Launched 04:44:00.893760 run osmo-hlr_10.42.42.2(pid=28279): Launched 04:44:01.060775 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:01.870964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Launched 04:44:02.246063 run osmo-stp_10.42.42.5(pid=28282): Launched 04:44:02.462849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:03.019359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28284): Launched 04:44:03.142511 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:03.414396 run patchelf(pid=28285): Launched 04:44:03.592806 run osmo-stp_10.42.42.5(pid=28282): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] 04:44:03.730231 run osmo-stp_10.42.42.5(pid=28282): stdout: | (launched: 2022-12-10_04:44:02.175009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:03.869033 run osmo-stp_10.42.42.5(pid=28282): stderr: | 20221210044402431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044402431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044402431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044402432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044402432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044402432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044402432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:04.007447 run osmo-stp_10.42.42.5(pid=28282): stdout: | (launched: 2022-12-10_04:44:02.175009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:04.140148 run osmo-stp_10.42.42.5(pid=28282): stderr: | 20221210044402431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044402431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044402431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044402432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044402432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044402432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044402432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:04.296605 run patchelf(pid=28285): Terminating (SIGINT) 04:44:04.478004 run patchelf(pid=28285): Terminated: ok {rc=0} 04:44:04.609940 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28282): Process ended prematurely: osmo-stp_10.42.42.5(pid=28282) [trial-2369↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] [trial-2369↪gprs:nanobts+band-900↪iperf3m4.py:8] 04:44:04.620421 tst iperf3m4.py:8: Test FAILED (11.0 sec) 04:44:04.649586 run osmo-hlr_10.42.42.2(pid=28279): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28279)] 04:44:04.699863 run osmo-hlr_10.42.42.2(pid=28279): stdout: | (launched: 2022-12-10_04:44:00.805664) 04:44:04.751730 run osmo-hlr_10.42.42.2(pid=28279): stderr: | 20221210044401127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044401127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044401127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044401127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044401127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044401128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044401155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044401166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044401168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044401168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:04.804090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28268): Terminating (SIGTERM) 04:44:04.846256 run iperf3-srv_10.42.42.10(pid=28269): Terminating (SIGTERM) 04:44:04.888071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28270): Terminating (SIGTERM) 04:44:04.930081 run iperf3-srv_10.42.42.10(pid=28271): Terminating (SIGTERM) 04:44:04.971973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28272): Terminating (SIGTERM) 04:44:05.013960 run iperf3-srv_10.42.42.10(pid=28273): Terminating (SIGTERM) 04:44:05.055611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28274): Terminating (SIGTERM) 04:44:05.097482 run iperf3-srv_10.42.42.10(pid=28275): Terminating (SIGTERM) 04:44:05.139148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Terminating (SIGTERM) 04:44:05.180918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Terminating (SIGTERM) 04:44:05.222719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28284): Terminating (SIGTERM) 04:44:05.264821 --- ParallelTerminationStrategy: PID 28268 died... 04:44:05.285047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28268): Terminated: ok {rc=0} 04:44:05.331583 --- ParallelTerminationStrategy: PID 28269 died... 04:44:05.351302 run iperf3-srv_10.42.42.10(pid=28269): Terminated {rc=256} 04:44:05.397526 --- ParallelTerminationStrategy: PID 28270 died... 04:44:05.417187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28270): Terminated: ok {rc=0} 04:44:05.463356 --- ParallelTerminationStrategy: PID 28271 died... 04:44:05.482941 run iperf3-srv_10.42.42.10(pid=28271): Terminated {rc=256} 04:44:05.528606 --- ParallelTerminationStrategy: PID 28272 died... 04:44:05.548147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28272): Terminated: ok {rc=0} 04:44:05.594318 --- ParallelTerminationStrategy: PID 28273 died... 04:44:05.613958 run iperf3-srv_10.42.42.10(pid=28273): Terminated {rc=256} 04:44:05.660459 --- ParallelTerminationStrategy: PID 28274 died... 04:44:05.680240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28274): Terminated: ok {rc=0} 04:44:05.726689 --- ParallelTerminationStrategy: PID 28275 died... 04:44:05.746475 run iperf3-srv_10.42.42.10(pid=28275): Terminated {rc=256} 04:44:05.793096 --- ParallelTerminationStrategy: PID 28278 died... 04:44:05.812644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Terminated: ok {rc=0} 04:44:05.858908 --- ParallelTerminationStrategy: PID 28281 died... 04:44:05.878618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Terminated: ok {rc=0} 04:44:05.924826 --- ParallelTerminationStrategy: PID 28284 died... 04:44:05.944862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28284): Terminated: ok {rc=0} 04:44:06.032280 bus /gobi_4: Setting Powered False 04:44:07.132095 bus /gobi_4: Setting Powered False 04:44:08.246068 bus /gobi_1: Setting Powered False 04:44:09.340202 bus /gobi_1: Setting Powered False 04:44:10.455519 bus /gobi_0: Setting Powered False 04:44:11.554987 bus /gobi_0: Setting Powered False 04:44:12.671545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900 ping.py ---------------------------------------------- 04:44:13.774338 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:13.786199 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:13.835745 tst ping.py: using LAC 26075 04:44:13.961863 tst ping.py: using RAC 65 04:44:14.085609 tst ping.py: using CellId 26075 04:44:14.206056 tst ping.py: using BVCI 26076 04:44:14.323224 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:14.334704 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:14.346232 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:14.357726 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:14.369110 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:14.380367 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:14.392007 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:14.403693 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:14.520348 tst ping.py:19: start network... 04:44:14.734235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:15.224524 run create_hlr_db(pid=28286): Launched 04:44:15.352083 bus /gobi_6: Setting Powered False 04:44:16.414829 run create_hlr_db(pid=28286): Terminated: ok {rc=0} 04:44:16.873775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28288): Launched 04:44:17.228031 run osmo-hlr_10.42.42.2(pid=28289): Launched 04:44:17.349385 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:17.898330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28291): Launched 04:44:18.216767 run osmo-stp_10.42.42.5(pid=28292): Launched 04:44:18.336610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:18.883121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28294): Launched 04:44:19.003810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:19.271599 run patchelf(pid=28295): Launched 04:44:19.447626 run osmo-stp_10.42.42.5(pid=28292): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28292)] 04:44:19.582479 run osmo-stp_10.42.42.5(pid=28292): stdout: | (launched: 2022-12-10_04:44:18.158367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:19.718966 run osmo-stp_10.42.42.5(pid=28292): stderr: | 20221210044418350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044418350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044418351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044418351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044418353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044418354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044418354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:19.854645 run osmo-stp_10.42.42.5(pid=28292): stdout: | (launched: 2022-12-10_04:44:18.158367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:19.985039 run osmo-stp_10.42.42.5(pid=28292): stderr: | 20221210044418350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044418350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044418351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044418351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044418353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044418354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044418354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:20.138857 run patchelf(pid=28295): Terminating (SIGINT) 04:44:20.316588 run patchelf(pid=28295): Terminated: ok {rc=0} 04:44:20.444942 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28292): Process ended prematurely: osmo-stp_10.42.42.5(pid=28292) [trial-2369↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28292)] [trial-2369↪gprs:nanobts+band-900↪ping.py:22] 04:44:20.455160 tst ping.py:22: Test FAILED (6.7 sec) 04:44:20.484193 run osmo-hlr_10.42.42.2(pid=28289): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28289)] 04:44:20.534156 run osmo-hlr_10.42.42.2(pid=28289): stdout: | (launched: 2022-12-10_04:44:17.169675) 04:44:20.585738 run osmo-hlr_10.42.42.2(pid=28289): stderr: | 20221210044417365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044417365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044417365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044417365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044417365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044417365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044417382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044417391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044417392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044417392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:20.637753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28288): Terminating (SIGTERM) 04:44:20.679938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28291): Terminating (SIGTERM) 04:44:20.721960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28294): Terminating (SIGTERM) 04:44:20.763997 --- ParallelTerminationStrategy: PID 28288 died... 04:44:20.784131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28288): Terminated: ok {rc=0} 04:44:20.830562 --- ParallelTerminationStrategy: PID 28291 died... 04:44:20.850187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28291): Terminated: ok {rc=0} 04:44:20.896278 --- ParallelTerminationStrategy: PID 28294 died... 04:44:20.915947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28294): Terminated: ok {rc=0} 04:44:21.002709 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 04:44:22.090506 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.102861 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:22.153553 tst ping_idle_ping.py: using LAC 26076 04:44:22.280616 tst ping_idle_ping.py: using RAC 66 04:44:22.407384 tst ping_idle_ping.py: using CellId 26076 04:44:22.533395 tst ping_idle_ping.py: using BVCI 26077 04:44:22.648621 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.660034 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.671726 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.683158 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.694617 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.705817 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.717333 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:22.728621 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:22.844650 tst ping_idle_ping.py:24: start network... 04:44:23.045174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:23.510052 run create_hlr_db(pid=28296): Launched 04:44:23.624224 bus /gobi_6: Setting Powered False 04:44:24.684310 run create_hlr_db(pid=28296): Terminated: ok {rc=0} 04:44:25.118512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28299): Launched 04:44:25.434903 run osmo-hlr_10.42.42.2(pid=28300): Launched 04:44:25.555319 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:26.102476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28302): Launched 04:44:26.420576 run osmo-stp_10.42.42.5(pid=28303): Launched 04:44:26.542144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:27.092135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28305): Launched 04:44:27.213721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:27.482648 run patchelf(pid=28306): Launched 04:44:27.658153 run osmo-stp_10.42.42.5(pid=28303): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28303)] 04:44:27.793206 run osmo-stp_10.42.42.5(pid=28303): stdout: | (launched: 2022-12-10_04:44:26.362257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:27.928921 run osmo-stp_10.42.42.5(pid=28303): stderr: | 20221210044426555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044426555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044426555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044426555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044426556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044426556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044426556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:28.065133 run osmo-stp_10.42.42.5(pid=28303): stdout: | (launched: 2022-12-10_04:44:26.362257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:28.195045 run osmo-stp_10.42.42.5(pid=28303): stderr: | 20221210044426555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044426555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044426555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044426555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044426556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044426556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044426556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:28.349620 run patchelf(pid=28306): Terminating (SIGINT) 04:44:28.527640 run patchelf(pid=28306): Terminated: ok {rc=0} 04:44:28.656014 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28303): Process ended prematurely: osmo-stp_10.42.42.5(pid=28303) [trial-2369↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28303)] [trial-2369↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 04:44:28.666006 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:44:28.695264 run osmo-hlr_10.42.42.2(pid=28300): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28300)] 04:44:28.745815 run osmo-hlr_10.42.42.2(pid=28300): stdout: | (launched: 2022-12-10_04:44:25.376776) 04:44:28.797897 run osmo-hlr_10.42.42.2(pid=28300): stderr: | 20221210044425573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044425573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044425573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044425573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044425573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044425573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044425585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044425594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044425594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044425594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:28.850258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28299): Terminating (SIGTERM) 04:44:28.892441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28302): Terminating (SIGTERM) 04:44:28.934442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28305): Terminating (SIGTERM) 04:44:28.976854 --- ParallelTerminationStrategy: PID 28299 died... 04:44:28.996588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28299): Terminated: ok {rc=0} 04:44:29.043744 --- ParallelTerminationStrategy: PID 28302 died... 04:44:29.063517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28302): Terminated: ok {rc=0} 04:44:29.109817 --- ParallelTerminationStrategy: PID 28305 died... 04:44:29.129511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28305): Terminated: ok {rc=0} 04:44:29.216297 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 04:44:30.519718 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:44:30.526631 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:44:30.560153 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:44:30.600251 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:44:30.687711 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:44:30.721329 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:44:30.761234 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:44:31.370157 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:44:31.424263 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:31.439726 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:44:31.502806 tst cs_paging_gprs_active.py: using LAC 26077 04:44:31.629792 tst cs_paging_gprs_active.py: using RAC 67 04:44:31.766216 tst cs_paging_gprs_active.py: using CellId 26077 04:44:31.887569 tst cs_paging_gprs_active.py: using BVCI 26078 04:44:32.045440 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.061194 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.075454 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.088336 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.103280 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.118472 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.134169 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.149362 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:32.164145 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:44:32.300358 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:44:32.421816 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:44:32.640910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:32.965452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28311): Launched 04:44:33.246265 run iperf3-srv_10.42.42.10(pid=28312): Launched 04:44:33.367109 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:44:33.585796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:33.910980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28313): Launched 04:44:34.191384 run iperf3-srv_10.42.42.10(pid=28314): Launched 04:44:34.312616 tst cs_paging_gprs_active.py:38: start network... 04:44:34.530705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:35.031154 run create_hlr_db(pid=28315): Launched 04:44:35.162307 bus /gobi_6: Setting Powered False 04:44:36.226166 run create_hlr_db(pid=28315): Terminated: ok {rc=0} 04:44:36.677718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28317): Launched 04:44:37.000430 run osmo-hlr_10.42.42.2(pid=28318): Launched 04:44:37.123469 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:37.682675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28321): Launched 04:44:38.005260 run osmo-stp_10.42.42.5(pid=28322): Launched 04:44:38.128583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:38.687195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28324): Launched 04:44:38.811043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:39.084115 run patchelf(pid=28325): Launched 04:44:39.263286 run osmo-stp_10.42.42.5(pid=28322): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28322)] 04:44:39.399809 run osmo-stp_10.42.42.5(pid=28322): stdout: | (launched: 2022-12-10_04:44:37.945957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:39.538136 run osmo-stp_10.42.42.5(pid=28322): stderr: | 20221210044438139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044438139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044438139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044438140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044438140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044438140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044438140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:39.676618 run osmo-stp_10.42.42.5(pid=28322): stdout: | (launched: 2022-12-10_04:44:37.945957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:39.808340 run osmo-stp_10.42.42.5(pid=28322): stderr: | 20221210044438139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044438139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044438139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044438140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044438140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044438140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044438140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:39.964721 run patchelf(pid=28325): Terminating (SIGINT) 04:44:40.145574 run patchelf(pid=28325): Terminated: ok {rc=0} 04:44:40.275625 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28322): Process ended prematurely: osmo-stp_10.42.42.5(pid=28322) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28322)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:44:40.286136 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:44:40.314597 run osmo-hlr_10.42.42.2(pid=28318): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28318)] 04:44:40.365417 run osmo-hlr_10.42.42.2(pid=28318): stdout: | (launched: 2022-12-10_04:44:36.941084) 04:44:40.416566 run osmo-hlr_10.42.42.2(pid=28318): stderr: | 20221210044437140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044437140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044437140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044437140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044437140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044437140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044437153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044437161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044437162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044437162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:40.468055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28311): Terminating (SIGTERM) 04:44:40.509507 run iperf3-srv_10.42.42.10(pid=28312): Terminating (SIGTERM) 04:44:40.550758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28313): Terminating (SIGTERM) 04:44:40.592078 run iperf3-srv_10.42.42.10(pid=28314): Terminating (SIGTERM) 04:44:40.633364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28317): Terminating (SIGTERM) 04:44:40.674824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28321): Terminating (SIGTERM) 04:44:40.716089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28324): Terminating (SIGTERM) 04:44:40.757753 --- ParallelTerminationStrategy: PID 28311 died... 04:44:40.777664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28311): Terminated: ok {rc=0} 04:44:40.823605 --- ParallelTerminationStrategy: PID 28312 died... 04:44:40.843120 run iperf3-srv_10.42.42.10(pid=28312): Terminated {rc=256} 04:44:40.888772 --- ParallelTerminationStrategy: PID 28313 died... 04:44:40.908277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28313): Terminated: ok {rc=0} 04:44:40.954015 --- ParallelTerminationStrategy: PID 28314 died... 04:44:40.973331 run iperf3-srv_10.42.42.10(pid=28314): Terminated {rc=256} 04:44:41.018820 --- ParallelTerminationStrategy: PID 28317 died... 04:44:41.038383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28317): Terminated: ok {rc=0} 04:44:41.084068 --- ParallelTerminationStrategy: PID 28321 died... 04:44:41.103623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28321): Terminated: ok {rc=0} 04:44:41.149316 --- ParallelTerminationStrategy: PID 28324 died... 04:44:41.168596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28324): Terminated: ok {rc=0} 04:44:41.254647 bus /gobi_0: Setting Powered False 04:44:42.354037 bus /gobi_0: Setting Powered False 04:44:43.469788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:44:44.619001 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:44.631337 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:44:44.684233 tst iperf3.py: using LAC 26078 04:44:44.811485 tst iperf3.py: using RAC 68 04:44:44.931894 tst iperf3.py: using CellId 26078 04:44:45.064876 tst iperf3.py: using BVCI 26079 04:44:45.182671 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.194330 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.205736 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.217682 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.228712 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.239941 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.251327 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.262500 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:45.273908 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:44:45.390744 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:44:45.595201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:45.929808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28326): Launched 04:44:46.214583 run iperf3-srv_10.42.42.10(pid=28327): Launched 04:44:46.345681 tst iperf3.py:8: start network... 04:44:46.555919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:47.037481 run create_hlr_db(pid=28328): Launched 04:44:47.215067 bus /gobi_6: Setting Powered False 04:44:48.279144 run create_hlr_db(pid=28328): Terminated: ok {rc=0} 04:44:48.711371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28330): Launched 04:44:49.014788 run osmo-hlr_10.42.42.2(pid=28331): Launched 04:44:49.130246 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:49.669211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28333): Launched 04:44:49.972153 run osmo-stp_10.42.42.5(pid=28334): Launched 04:44:50.087030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:50.610029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28336): Launched 04:44:50.726588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:50.984006 run patchelf(pid=28337): Launched 04:44:51.152470 run osmo-stp_10.42.42.5(pid=28334): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28334)] 04:44:51.281213 run osmo-stp_10.42.42.5(pid=28334): stdout: | (launched: 2022-12-10_04:44:49.916103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:51.411332 run osmo-stp_10.42.42.5(pid=28334): stderr: | 20221210044450085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044450086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044450086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044450086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044450087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044450087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044450087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:51.541963 run osmo-stp_10.42.42.5(pid=28334): stdout: | (launched: 2022-12-10_04:44:49.916103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:51.665924 run osmo-stp_10.42.42.5(pid=28334): stderr: | 20221210044450085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044450086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044450086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044450086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044450087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044450087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044450087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:51.813328 run patchelf(pid=28337): Terminating (SIGINT) 04:44:51.983637 run patchelf(pid=28337): Terminated: ok {rc=0} 04:44:52.106466 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28334): Process ended prematurely: osmo-stp_10.42.42.5(pid=28334) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28334)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 04:44:52.116122 tst iperf3.py:8: Test FAILED (7.5 sec) 04:44:52.144162 run osmo-hlr_10.42.42.2(pid=28331): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28331)] 04:44:52.191825 run osmo-hlr_10.42.42.2(pid=28331): stdout: | (launched: 2022-12-10_04:44:48.959003) 04:44:52.241321 run osmo-hlr_10.42.42.2(pid=28331): stderr: | 20221210044449135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044449135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044449135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044449135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044449135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044449135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044449147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044449157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044449157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044449157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:52.291098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28326): Terminating (SIGTERM) 04:44:52.330941 run iperf3-srv_10.42.42.10(pid=28327): Terminating (SIGTERM) 04:44:52.370833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28330): Terminating (SIGTERM) 04:44:52.411013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28333): Terminating (SIGTERM) 04:44:52.451018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28336): Terminating (SIGTERM) 04:44:52.491231 --- ParallelTerminationStrategy: PID 28326 died... 04:44:52.510246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28326): Terminated: ok {rc=0} 04:44:52.554872 --- ParallelTerminationStrategy: PID 28327 died... 04:44:52.573626 run iperf3-srv_10.42.42.10(pid=28327): Terminated {rc=256} 04:44:52.618075 --- ParallelTerminationStrategy: PID 28330 died... 04:44:52.636805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28330): Terminated: ok {rc=0} 04:44:52.681722 --- ParallelTerminationStrategy: PID 28333 died... 04:44:52.700208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28333): Terminated: ok {rc=0} 04:44:52.745239 --- ParallelTerminationStrategy: PID 28336 died... 04:44:52.763754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28336): Terminated: ok {rc=0} 04:44:52.850624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:44:53.998628 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.010492 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:44:54.060267 tst iperf3m4.py: using LAC 26079 04:44:54.189046 tst iperf3m4.py: using RAC 69 04:44:54.315870 tst iperf3m4.py: using CellId 26079 04:44:54.442112 tst iperf3m4.py: using BVCI 26080 04:44:54.560022 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.571656 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.583180 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.595050 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.606758 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.618369 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.630346 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.642665 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:44:54.654098 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:44:54.771156 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:44:54.889553 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:44:55.008502 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:44:55.128537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:44:55.348285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:55.673783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28339): Launched 04:44:55.955942 run iperf3-srv_10.42.42.10(pid=28340): Launched 04:44:56.077101 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:44:56.294994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:56.620006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28341): Launched 04:44:56.901454 run iperf3-srv_10.42.42.10(pid=28342): Launched 04:44:57.021529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:44:57.239308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:57.563594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28343): Launched 04:44:57.846163 run iperf3-srv_10.42.42.10(pid=28344): Launched 04:44:57.966566 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:44:58.183894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:58.508443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28345): Launched 04:44:58.789626 run iperf3-srv_10.42.42.10(pid=28346): Launched 04:44:58.909540 tst iperf3m4.py:8: start network... 04:44:59.126904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:59.625481 run create_hlr_db(pid=28347): Launched 04:44:59.755088 bus /gobi_6: Setting Powered False 04:45:00.819138 run create_hlr_db(pid=28347): Terminated: ok {rc=0} 04:45:01.330224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28353): Launched 04:45:01.671026 run osmo-hlr_10.42.42.2(pid=28354): Launched 04:45:01.904638 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:02.586149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28356): Launched 04:45:02.911958 run osmo-stp_10.42.42.5(pid=28357): Launched 04:45:03.035201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:03.593485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28359): Launched 04:45:03.717181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:03.990662 run patchelf(pid=28360): Launched 04:45:04.170025 run osmo-stp_10.42.42.5(pid=28357): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28357)] 04:45:04.307093 run osmo-stp_10.42.42.5(pid=28357): stdout: | (launched: 2022-12-10_04:45:02.852370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:04.445724 run osmo-stp_10.42.42.5(pid=28357): stderr: | 20221210044503044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044503044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044503045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044503045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044503046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044503046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044503046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:04.584012 run osmo-stp_10.42.42.5(pid=28357): stdout: | (launched: 2022-12-10_04:45:02.852370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:04.716128 run osmo-stp_10.42.42.5(pid=28357): stderr: | 20221210044503044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044503044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044503045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044503045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044503046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044503046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044503046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:04.872549 run patchelf(pid=28360): Terminating (SIGINT) 04:45:05.052875 run patchelf(pid=28360): Terminated: ok {rc=0} 04:45:05.183397 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28357): Process ended prematurely: osmo-stp_10.42.42.5(pid=28357) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28357)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 04:45:05.193969 tst iperf3m4.py:8: Test FAILED (11.2 sec) 04:45:05.223149 run osmo-hlr_10.42.42.2(pid=28354): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28354)] 04:45:05.273351 run osmo-hlr_10.42.42.2(pid=28354): stdout: | (launched: 2022-12-10_04:45:01.607106) 04:45:05.325395 run osmo-hlr_10.42.42.2(pid=28354): stderr: | 20221210044501871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044501871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044501871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044501871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044501871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044501871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044501889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044501903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044501904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044501904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:05.377744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28339): Terminating (SIGTERM) 04:45:05.419772 run iperf3-srv_10.42.42.10(pid=28340): Terminating (SIGTERM) 04:45:05.462004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28341): Terminating (SIGTERM) 04:45:05.503970 run iperf3-srv_10.42.42.10(pid=28342): Terminating (SIGTERM) 04:45:05.545945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28343): Terminating (SIGTERM) 04:45:05.588061 run iperf3-srv_10.42.42.10(pid=28344): Terminating (SIGTERM) 04:45:05.629974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28345): Terminating (SIGTERM) 04:45:05.672013 run iperf3-srv_10.42.42.10(pid=28346): Terminating (SIGTERM) 04:45:05.714235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28353): Terminating (SIGTERM) 04:45:05.756410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28356): Terminating (SIGTERM) 04:45:05.798403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28359): Terminating (SIGTERM) 04:45:05.840852 --- ParallelTerminationStrategy: PID 28339 died... 04:45:05.861295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28339): Terminated: ok {rc=0} 04:45:05.907869 --- ParallelTerminationStrategy: PID 28340 died... 04:45:05.927603 run iperf3-srv_10.42.42.10(pid=28340): Terminated {rc=256} 04:45:05.974139 --- ParallelTerminationStrategy: PID 28341 died... 04:45:05.993887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28341): Terminated: ok {rc=0} 04:45:06.040394 --- ParallelTerminationStrategy: PID 28342 died... 04:45:06.060121 run iperf3-srv_10.42.42.10(pid=28342): Terminated {rc=256} 04:45:06.106223 --- ParallelTerminationStrategy: PID 28343 died... 04:45:06.125889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28343): Terminated: ok {rc=0} 04:45:06.171991 --- ParallelTerminationStrategy: PID 28344 died... 04:45:06.191654 run iperf3-srv_10.42.42.10(pid=28344): Terminated {rc=256} 04:45:06.237922 --- ParallelTerminationStrategy: PID 28345 died... 04:45:06.257510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28345): Terminated: ok {rc=0} 04:45:06.303701 --- ParallelTerminationStrategy: PID 28346 died... 04:45:06.323384 run iperf3-srv_10.42.42.10(pid=28346): Terminated {rc=256} 04:45:06.369535 --- ParallelTerminationStrategy: PID 28353 died... 04:45:06.389176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28353): Terminated: ok {rc=0} 04:45:06.435423 --- ParallelTerminationStrategy: PID 28356 died... 04:45:06.455419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28356): Terminated: ok {rc=0} 04:45:06.501922 --- ParallelTerminationStrategy: PID 28359 died... 04:45:06.521769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28359): Terminated: ok {rc=0} 04:45:06.610264 bus /gobi_4: Setting Powered False 04:45:07.707975 bus /gobi_4: Setting Powered False 04:45:08.824809 bus /gobi_1: Setting Powered False 04:45:09.924507 bus /gobi_1: Setting Powered False 04:45:11.039617 bus /gobi_0: Setting Powered False 04:45:12.138989 bus /gobi_0: Setting Powered False 04:45:13.256133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 04:45:14.359692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.371387 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:14.420491 tst ping.py: using LAC 26080 04:45:14.541410 tst ping.py: using RAC 70 04:45:14.658487 tst ping.py: using CellId 26080 04:45:14.772903 tst ping.py: using BVCI 26081 04:45:14.880406 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.891461 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.902376 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.913428 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.924380 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.935359 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.946543 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:14.957637 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:15.070259 tst ping.py:19: start network... 04:45:15.268877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:15.728490 run create_hlr_db(pid=28361): Launched 04:45:15.847308 bus /gobi_6: Setting Powered False 04:45:16.917878 run create_hlr_db(pid=28361): Terminated: ok {rc=0} 04:45:17.388760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28363): Launched 04:45:17.706267 run osmo-hlr_10.42.42.2(pid=28364): Launched 04:45:17.826457 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:18.373866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28366): Launched 04:45:18.690270 run osmo-stp_10.42.42.5(pid=28367): Launched 04:45:18.810398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:19.358305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28369): Launched 04:45:19.479216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:19.748047 run patchelf(pid=28370): Launched 04:45:19.924345 run osmo-stp_10.42.42.5(pid=28367): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28367)] 04:45:20.058635 run osmo-stp_10.42.42.5(pid=28367): stdout: | (launched: 2022-12-10_04:45:18.631434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:20.194624 run osmo-stp_10.42.42.5(pid=28367): stderr: | 20221210044518826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044518826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044518826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044518827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044518827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044518827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044518827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:20.330734 run osmo-stp_10.42.42.5(pid=28367): stdout: | (launched: 2022-12-10_04:45:18.631434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:20.460791 run osmo-stp_10.42.42.5(pid=28367): stderr: | 20221210044518826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044518826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044518826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044518827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044518827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044518827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044518827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:20.615294 run patchelf(pid=28370): Terminating (SIGINT) 04:45:20.793728 run patchelf(pid=28370): Terminated: ok {rc=0} 04:45:20.921560 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28367): Process ended prematurely: osmo-stp_10.42.42.5(pid=28367) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28367)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 04:45:20.931349 tst ping.py:22: Test FAILED (6.6 sec) 04:45:20.959713 run osmo-hlr_10.42.42.2(pid=28364): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28364)] 04:45:21.009399 run osmo-hlr_10.42.42.2(pid=28364): stdout: | (launched: 2022-12-10_04:45:17.647464) 04:45:21.060601 run osmo-hlr_10.42.42.2(pid=28364): stderr: | 20221210044517845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044517846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044517846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044517846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044517846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044517846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044517859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044517867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044517867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044517867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:21.112329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28363): Terminating (SIGTERM) 04:45:21.153882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28366): Terminating (SIGTERM) 04:45:21.195157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28369): Terminating (SIGTERM) 04:45:21.236766 --- ParallelTerminationStrategy: PID 28363 died... 04:45:21.256543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28363): Terminated: ok {rc=0} 04:45:21.303132 --- ParallelTerminationStrategy: PID 28366 died... 04:45:21.322731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28366): Terminated: ok {rc=0} 04:45:21.368920 --- ParallelTerminationStrategy: PID 28369 died... 04:45:21.388507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28369): Terminated: ok {rc=0} 04:45:21.475588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:45:22.562412 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:22.574912 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:22.631830 tst ping_idle_ping.py: using LAC 26081 04:45:22.756907 tst ping_idle_ping.py: using RAC 71 04:45:22.879038 tst ping_idle_ping.py: using CellId 26081 04:45:23.001476 tst ping_idle_ping.py: using BVCI 26082 04:45:23.115920 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:23.127503 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:23.138903 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:23.150289 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:23.161617 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:23.172798 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:23.184416 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:23.195830 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:23.308846 tst ping_idle_ping.py:24: start network... 04:45:23.510109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:23.974162 run create_hlr_db(pid=28371): Launched 04:45:24.088217 bus /gobi_6: Setting Powered False 04:45:25.148575 run create_hlr_db(pid=28371): Terminated: ok {rc=0} 04:45:25.587016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28373): Launched 04:45:25.905670 run osmo-hlr_10.42.42.2(pid=28374): Launched 04:45:26.026106 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:26.573613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28376): Launched 04:45:26.892595 run osmo-stp_10.42.42.5(pid=28377): Launched 04:45:27.013680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:27.562806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28379): Launched 04:45:27.683668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:27.951818 run patchelf(pid=28380): Launched 04:45:28.128019 run osmo-stp_10.42.42.5(pid=28377): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28377)] 04:45:28.262389 run osmo-stp_10.42.42.5(pid=28377): stdout: | (launched: 2022-12-10_04:45:26.834140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:28.398324 run osmo-stp_10.42.42.5(pid=28377): stderr: | 20221210044527027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044527027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044527028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044527028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044527028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044527029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044527029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:28.533924 run osmo-stp_10.42.42.5(pid=28377): stdout: | (launched: 2022-12-10_04:45:26.834140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:28.664178 run osmo-stp_10.42.42.5(pid=28377): stderr: | 20221210044527027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044527027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044527028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044527028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044527028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044527029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044527029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:28.818979 run patchelf(pid=28380): Terminating (SIGINT) 04:45:28.996790 run patchelf(pid=28380): Terminated: ok {rc=0} 04:45:29.125155 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28377): Process ended prematurely: osmo-stp_10.42.42.5(pid=28377) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28377)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 04:45:29.135147 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:45:29.163457 run osmo-hlr_10.42.42.2(pid=28374): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28374)] 04:45:29.213116 run osmo-hlr_10.42.42.2(pid=28374): stdout: | (launched: 2022-12-10_04:45:25.847360) 04:45:29.264234 run osmo-hlr_10.42.42.2(pid=28374): stderr: | 20221210044526046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044526046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044526046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044526046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044526047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044526047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044526059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044526067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044526068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044526068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:29.315643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28373): Terminating (SIGTERM) 04:45:29.357216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28376): Terminating (SIGTERM) 04:45:29.398828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28379): Terminating (SIGTERM) 04:45:29.440712 --- ParallelTerminationStrategy: PID 28373 died... 04:45:29.460387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28373): Terminated: ok {rc=0} 04:45:29.506596 --- ParallelTerminationStrategy: PID 28376 died... 04:45:29.526316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28376): Terminated: ok {rc=0} 04:45:29.572324 --- ParallelTerminationStrategy: PID 28379 died... 04:45:29.592351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28379): Terminated: ok {rc=0} 04:45:29.679092 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:45:31.008239 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:45:31.020296 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:45:31.056359 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:45:31.107750 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:45:31.216598 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:45:31.251231 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:45:31.293405 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:45:31.926324 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:45:31.995806 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.011074 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:45:32.081168 tst cs_paging_gprs_active.py: using LAC 26082 04:45:32.207962 tst cs_paging_gprs_active.py: using RAC 72 04:45:32.349138 tst cs_paging_gprs_active.py: using CellId 26082 04:45:32.468307 tst cs_paging_gprs_active.py: using BVCI 26083 04:45:32.578939 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.590476 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.601417 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.613300 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.624931 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.636793 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.648686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.660339 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:32.672136 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:45:32.793762 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:45:32.914164 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:45:33.134369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:33.459364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28384): Launched 04:45:33.741924 run iperf3-srv_10.42.42.10(pid=28385): Launched 04:45:33.863132 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:45:34.082264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:34.407691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28386): Launched 04:45:34.689459 run iperf3-srv_10.42.42.10(pid=28387): Launched 04:45:34.811097 tst cs_paging_gprs_active.py:38: start network... 04:45:35.029372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:35.529451 run create_hlr_db(pid=28388): Launched 04:45:35.661035 bus /gobi_6: Setting Powered False 04:45:36.726153 run create_hlr_db(pid=28388): Terminated: ok {rc=0} 04:45:37.160546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28390): Launched 04:45:37.464172 run osmo-hlr_10.42.42.2(pid=28391): Launched 04:45:37.583183 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:38.119027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28393): Launched 04:45:38.422511 run osmo-stp_10.42.42.5(pid=28394): Launched 04:45:38.538378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:39.063327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28396): Launched 04:45:39.180213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:39.437671 run patchelf(pid=28397): Launched 04:45:39.606688 run osmo-stp_10.42.42.5(pid=28394): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28394)] 04:45:39.735409 run osmo-stp_10.42.42.5(pid=28394): stdout: | (launched: 2022-12-10_04:45:38.366177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:39.866420 run osmo-stp_10.42.42.5(pid=28394): stderr: | 20221210044538537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044538537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044538537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044538537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044538538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044538538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044538538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:40.003599 run osmo-stp_10.42.42.5(pid=28394): stdout: | (launched: 2022-12-10_04:45:38.366177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:40.136702 run osmo-stp_10.42.42.5(pid=28394): stderr: | 20221210044538537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044538537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044538537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044538537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044538538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044538538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044538538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:40.294271 run patchelf(pid=28397): Terminating (SIGINT) 04:45:40.475459 run patchelf(pid=28397): Terminated: ok {rc=0} 04:45:40.606088 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28394): Process ended prematurely: osmo-stp_10.42.42.5(pid=28394) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28394)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:45:40.616620 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:45:40.645624 run osmo-hlr_10.42.42.2(pid=28391): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28391)] 04:45:40.695878 run osmo-hlr_10.42.42.2(pid=28391): stdout: | (launched: 2022-12-10_04:45:37.407839) 04:45:40.748242 run osmo-hlr_10.42.42.2(pid=28391): stderr: | 20221210044537585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044537585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044537586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044537586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044537586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044537586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044537599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044537609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044537609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044537609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:40.800393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28384): Terminating (SIGTERM) 04:45:40.842794 run iperf3-srv_10.42.42.10(pid=28385): Terminating (SIGTERM) 04:45:40.884477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28386): Terminating (SIGTERM) 04:45:40.926371 run iperf3-srv_10.42.42.10(pid=28387): Terminating (SIGTERM) 04:45:40.967892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28390): Terminating (SIGTERM) 04:45:41.009687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28393): Terminating (SIGTERM) 04:45:41.051466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28396): Terminating (SIGTERM) 04:45:41.093666 --- ParallelTerminationStrategy: PID 28384 died... 04:45:41.113908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28384): Terminated: ok {rc=0} 04:45:41.160606 --- ParallelTerminationStrategy: PID 28385 died... 04:45:41.180582 run iperf3-srv_10.42.42.10(pid=28385): Terminated {rc=256} 04:45:41.226829 --- ParallelTerminationStrategy: PID 28386 died... 04:45:41.246448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28386): Terminated: ok {rc=0} 04:45:41.292657 --- ParallelTerminationStrategy: PID 28387 died... 04:45:41.312820 run iperf3-srv_10.42.42.10(pid=28387): Terminated {rc=256} 04:45:41.359163 --- ParallelTerminationStrategy: PID 28390 died... 04:45:41.378973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28390): Terminated: ok {rc=0} 04:45:41.425342 --- ParallelTerminationStrategy: PID 28393 died... 04:45:41.445228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28393): Terminated: ok {rc=0} 04:45:41.491440 --- ParallelTerminationStrategy: PID 28396 died... 04:45:41.511111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28396): Terminated: ok {rc=0} 04:45:41.598666 bus /gobi_0: Setting Powered False 04:45:42.698474 bus /gobi_0: Setting Powered False 04:45:43.813281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:45:44.962371 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:44.974404 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:45:45.045419 tst iperf3.py: using LAC 26083 04:45:45.172702 tst iperf3.py: using RAC 73 04:45:45.299547 tst iperf3.py: using CellId 26083 04:45:45.425962 tst iperf3.py: using BVCI 26084 04:45:45.545127 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.556623 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.567977 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.579328 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.590648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.602035 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.613461 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.624613 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:45.636050 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:45:45.751434 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:45:45.984254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:46.322145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28398): Launched 04:45:46.613699 run iperf3-srv_10.42.42.10(pid=28399): Launched 04:45:46.770196 tst iperf3.py:8: start network... 04:45:46.994189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:47.500221 run create_hlr_db(pid=28400): Launched 04:45:47.632555 bus /gobi_6: Setting Powered False 04:45:48.697181 run create_hlr_db(pid=28400): Terminated: ok {rc=0} 04:45:49.148537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28402): Launched 04:45:49.473561 run osmo-hlr_10.42.42.2(pid=28403): Launched 04:45:49.597821 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:50.157502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28405): Launched 04:45:50.480135 run osmo-stp_10.42.42.5(pid=28406): Launched 04:45:50.603209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:51.162376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28408): Launched 04:45:51.285884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:51.559487 run patchelf(pid=28409): Launched 04:45:51.739206 run osmo-stp_10.42.42.5(pid=28406): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28406)] 04:45:51.875899 run osmo-stp_10.42.42.5(pid=28406): stdout: | (launched: 2022-12-10_04:45:50.420704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:52.014736 run osmo-stp_10.42.42.5(pid=28406): stderr: | 20221210044550618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044550618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044550619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044550619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044550619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044550619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044550620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:52.154592 run osmo-stp_10.42.42.5(pid=28406): stdout: | (launched: 2022-12-10_04:45:50.420704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:52.286496 run osmo-stp_10.42.42.5(pid=28406): stderr: | 20221210044550618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044550618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044550619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044550619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044550619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044550619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044550620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:52.443144 run patchelf(pid=28409): Terminating (SIGINT) 04:45:52.624380 run patchelf(pid=28409): Terminated: ok {rc=0} 04:45:52.755737 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28406): Process ended prematurely: osmo-stp_10.42.42.5(pid=28406) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28406)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 04:45:52.766383 tst iperf3.py:8: Test FAILED (7.8 sec) 04:45:52.795909 run osmo-hlr_10.42.42.2(pid=28403): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28403)] 04:45:52.845944 run osmo-hlr_10.42.42.2(pid=28403): stdout: | (launched: 2022-12-10_04:45:49.413920) 04:45:52.897528 run osmo-hlr_10.42.42.2(pid=28403): stderr: | 20221210044549614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044549614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044549614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044549614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044549614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044549614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044549626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044549634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044549635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044549635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:52.950177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28398): Terminating (SIGTERM) 04:45:52.991951 run iperf3-srv_10.42.42.10(pid=28399): Terminating (SIGTERM) 04:45:53.033636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28402): Terminating (SIGTERM) 04:45:53.075365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28405): Terminating (SIGTERM) 04:45:53.117181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28408): Terminating (SIGTERM) 04:45:53.159180 --- ParallelTerminationStrategy: PID 28398 died... 04:45:53.179293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28398): Terminated: ok {rc=0} 04:45:53.226116 --- ParallelTerminationStrategy: PID 28399 died... 04:45:53.245851 run iperf3-srv_10.42.42.10(pid=28399): Terminated {rc=256} 04:45:53.291978 --- ParallelTerminationStrategy: PID 28402 died... 04:45:53.311734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28402): Terminated: ok {rc=0} 04:45:53.357828 --- ParallelTerminationStrategy: PID 28405 died... 04:45:53.377742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28405): Terminated: ok {rc=0} 04:45:53.423983 --- ParallelTerminationStrategy: PID 28408 died... 04:45:53.443653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28408): Terminated: ok {rc=0} 04:45:53.531454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:45:54.681881 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:54.694408 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:45:54.766643 tst iperf3m4.py: using LAC 26084 04:45:54.895919 tst iperf3m4.py: using RAC 74 04:45:55.025653 tst iperf3m4.py: using CellId 26084 04:45:55.151692 tst iperf3m4.py: using BVCI 26085 04:45:55.268464 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.279948 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.291245 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.302548 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.313902 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.325296 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.336723 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.347961 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:45:55.359499 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:45:55.478542 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:45:55.597130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:45:55.713528 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:45:55.829805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:45:56.034282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:56.339081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28410): Launched 04:45:56.604268 run iperf3-srv_10.42.42.10(pid=28411): Launched 04:45:56.717407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:45:56.921189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:57.226694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28412): Launched 04:45:57.491582 run iperf3-srv_10.42.42.10(pid=28413): Launched 04:45:57.605439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:45:57.809773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:58.114721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28414): Launched 04:45:58.378679 run iperf3-srv_10.42.42.10(pid=28415): Launched 04:45:58.491987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:45:58.696066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:59.001899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28416): Launched 04:45:59.266479 run iperf3-srv_10.42.42.10(pid=28417): Launched 04:45:59.379789 tst iperf3m4.py:8: start network... 04:45:59.584234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:00.053499 run create_hlr_db(pid=28418): Launched 04:46:00.169521 bus /gobi_6: Setting Powered False 04:46:01.234581 run create_hlr_db(pid=28418): Terminated: ok {rc=0} 04:46:01.694554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28420): Launched 04:46:02.024386 run osmo-hlr_10.42.42.2(pid=28421): Launched 04:46:02.240159 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:02.774707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28423): Launched 04:46:03.079186 run osmo-stp_10.42.42.5(pid=28424): Launched 04:46:03.194424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:03.716735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28426): Launched 04:46:03.832776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:04.088451 run patchelf(pid=28427): Launched 04:46:04.255976 run osmo-stp_10.42.42.5(pid=28424): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28424)] 04:46:04.384094 run osmo-stp_10.42.42.5(pid=28424): stdout: | (launched: 2022-12-10_04:46:03.022693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:04.514144 run osmo-stp_10.42.42.5(pid=28424): stderr: | 20221210044603194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044603194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044603195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044603195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044603195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044603195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044603195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:04.644028 run osmo-stp_10.42.42.5(pid=28424): stdout: | (launched: 2022-12-10_04:46:03.022693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:04.767819 run osmo-stp_10.42.42.5(pid=28424): stderr: | 20221210044603194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044603194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044603195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044603195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044603195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044603195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044603195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:04.914593 run patchelf(pid=28427): Terminating (SIGINT) 04:46:05.085308 run patchelf(pid=28427): Terminated: ok {rc=0} 04:46:05.208412 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28424): Process ended prematurely: osmo-stp_10.42.42.5(pid=28424) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28424)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:46:05.218284 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:46:05.245853 run osmo-hlr_10.42.42.2(pid=28421): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28421)] 04:46:05.293506 run osmo-hlr_10.42.42.2(pid=28421): stdout: | (launched: 2022-12-10_04:46:01.964477) 04:46:05.342258 run osmo-hlr_10.42.42.2(pid=28421): stderr: | 20221210044602191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044602191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044602191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044602191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044602191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044602191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044602207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044602223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044602223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044602223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:05.391646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28410): Terminating (SIGTERM) 04:46:05.431089 run iperf3-srv_10.42.42.10(pid=28411): Terminating (SIGTERM) 04:46:05.470526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28412): Terminating (SIGTERM) 04:46:05.510143 run iperf3-srv_10.42.42.10(pid=28413): Terminating (SIGTERM) 04:46:05.549508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28414): Terminating (SIGTERM) 04:46:05.588885 run iperf3-srv_10.42.42.10(pid=28415): Terminating (SIGTERM) 04:46:05.628287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28416): Terminating (SIGTERM) 04:46:05.667605 run iperf3-srv_10.42.42.10(pid=28417): Terminating (SIGTERM) 04:46:05.706804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28420): Terminating (SIGTERM) 04:46:05.746658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28423): Terminating (SIGTERM) 04:46:05.786105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28426): Terminating (SIGTERM) 04:46:05.826411 --- ParallelTerminationStrategy: PID 28410 died... 04:46:05.845716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28410): Terminated: ok {rc=0} 04:46:05.890429 --- ParallelTerminationStrategy: PID 28411 died... 04:46:05.909235 run iperf3-srv_10.42.42.10(pid=28411): Terminated {rc=256} 04:46:05.953430 --- ParallelTerminationStrategy: PID 28412 died... 04:46:05.972182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28412): Terminated: ok {rc=0} 04:46:06.016552 --- ParallelTerminationStrategy: PID 28413 died... 04:46:06.035427 run iperf3-srv_10.42.42.10(pid=28413): Terminated {rc=256} 04:46:06.079694 --- ParallelTerminationStrategy: PID 28414 died... 04:46:06.098593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28414): Terminated: ok {rc=0} 04:46:06.143075 --- ParallelTerminationStrategy: PID 28415 died... 04:46:06.161956 run iperf3-srv_10.42.42.10(pid=28415): Terminated {rc=256} 04:46:06.206294 --- ParallelTerminationStrategy: PID 28416 died... 04:46:06.225279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28416): Terminated: ok {rc=0} 04:46:06.269581 --- ParallelTerminationStrategy: PID 28417 died... 04:46:06.288359 run iperf3-srv_10.42.42.10(pid=28417): Terminated {rc=256} 04:46:06.332651 --- ParallelTerminationStrategy: PID 28420 died... 04:46:06.351340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28420): Terminated: ok {rc=0} 04:46:06.395717 --- ParallelTerminationStrategy: PID 28423 died... 04:46:06.414617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28423): Terminated: ok {rc=0} 04:46:06.459017 --- ParallelTerminationStrategy: PID 28426 died... 04:46:06.477925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28426): Terminated: ok {rc=0} 04:46:06.563914 bus /gobi_4: Setting Powered False 04:46:07.664052 bus /gobi_4: Setting Powered False 04:46:08.779454 bus /gobi_1: Setting Powered False 04:46:09.878893 bus /gobi_1: Setting Powered False 04:46:10.991919 bus /gobi_0: Setting Powered False 04:46:12.086660 bus /gobi_0: Setting Powered False 04:46:13.203203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:46:14.306137 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.318034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:14.385274 tst ping.py: using LAC 26085 04:46:14.503269 tst ping.py: using RAC 75 04:46:14.619330 tst ping.py: using CellId 26085 04:46:14.737216 tst ping.py: using BVCI 26086 04:46:14.846112 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.857270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.868013 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.879136 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.890102 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.901266 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.912559 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:14.923805 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:15.037395 tst ping.py:19: start network... 04:46:15.237071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:15.696190 run create_hlr_db(pid=28428): Launched 04:46:15.808615 bus /gobi_6: Setting Powered False 04:46:16.901217 run create_hlr_db(pid=28428): Terminated: ok {rc=0} 04:46:17.374841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28430): Launched 04:46:17.693486 run osmo-hlr_10.42.42.2(pid=28431): Launched 04:46:17.814310 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:18.364731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Launched 04:46:18.681783 run osmo-stp_10.42.42.5(pid=28434): Launched 04:46:18.802584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:19.351730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Launched 04:46:19.473924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:19.743770 run patchelf(pid=28437): Launched 04:46:19.920878 run osmo-stp_10.42.42.5(pid=28434): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] 04:46:20.055776 run osmo-stp_10.42.42.5(pid=28434): stdout: | (launched: 2022-12-10_04:46:18.623476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:20.192249 run osmo-stp_10.42.42.5(pid=28434): stderr: | 20221210044618816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044618816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044618816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044618817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044618817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044618817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044618817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:20.328181 run osmo-stp_10.42.42.5(pid=28434): stdout: | (launched: 2022-12-10_04:46:18.623476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:20.458757 run osmo-stp_10.42.42.5(pid=28434): stderr: | 20221210044618816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044618816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044618816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044618817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044618817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044618817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044618817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:20.613111 run patchelf(pid=28437): Terminating (SIGINT) 04:46:20.791961 run patchelf(pid=28437): Terminated: ok {rc=0} 04:46:20.920489 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28434): Process ended prematurely: osmo-stp_10.42.42.5(pid=28434) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 04:46:20.930303 tst ping.py:22: Test FAILED (6.6 sec) 04:46:20.958952 run osmo-hlr_10.42.42.2(pid=28431): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28431)] 04:46:21.009197 run osmo-hlr_10.42.42.2(pid=28431): stdout: | (launched: 2022-12-10_04:46:17.634610) 04:46:21.060924 run osmo-hlr_10.42.42.2(pid=28431): stderr: | 20221210044617835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044617835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044617835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044617835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044617835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044617835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044617851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044617861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044617862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044617862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:21.113282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28430): Terminating (SIGTERM) 04:46:21.155598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Terminating (SIGTERM) 04:46:21.197455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Terminating (SIGTERM) 04:46:21.239435 --- ParallelTerminationStrategy: PID 28430 died... 04:46:21.259635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28430): Terminated: ok {rc=0} 04:46:21.306457 --- ParallelTerminationStrategy: PID 28433 died... 04:46:21.326322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Terminated: ok {rc=0} 04:46:21.372913 --- ParallelTerminationStrategy: PID 28436 died... 04:46:21.392721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Terminated: ok {rc=0} 04:46:21.480199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:46:22.567898 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:22.580218 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:22.650566 tst ping_idle_ping.py: using LAC 26086 04:46:22.777097 tst ping_idle_ping.py: using RAC 76 04:46:22.902247 tst ping_idle_ping.py: using CellId 26086 04:46:23.029274 tst ping_idle_ping.py: using BVCI 26087 04:46:23.144902 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:23.157241 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:23.169071 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:23.181248 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:23.193236 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:23.205253 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:23.217411 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:23.229518 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:23.348185 tst ping_idle_ping.py:24: start network... 04:46:23.564781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:24.062945 run create_hlr_db(pid=28438): Launched 04:46:24.192315 bus /gobi_6: Setting Powered False 04:46:25.256102 run create_hlr_db(pid=28438): Terminated: ok {rc=0} 04:46:25.700880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Launched 04:46:26.019299 run osmo-hlr_10.42.42.2(pid=28441): Launched 04:46:26.141097 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:26.694325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Launched 04:46:27.014128 run osmo-stp_10.42.42.5(pid=28444): Launched 04:46:27.135642 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:27.687997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28446): Launched 04:46:27.810353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:28.081285 run patchelf(pid=28447): Launched 04:46:28.258822 run osmo-stp_10.42.42.5(pid=28444): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] 04:46:28.394610 run osmo-stp_10.42.42.5(pid=28444): stdout: | (launched: 2022-12-10_04:46:26.955222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:28.531627 run osmo-stp_10.42.42.5(pid=28444): stderr: | 20221210044627149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044627149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044627149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044627150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044627150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044627150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044627150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:28.668858 run osmo-stp_10.42.42.5(pid=28444): stdout: | (launched: 2022-12-10_04:46:26.955222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:28.800482 run osmo-stp_10.42.42.5(pid=28444): stderr: | 20221210044627149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044627149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044627149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044627150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044627150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044627150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044627150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:28.955853 run patchelf(pid=28447): Terminating (SIGINT) 04:46:29.135097 run patchelf(pid=28447): Terminated: ok {rc=0} 04:46:29.264764 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28444): Process ended prematurely: osmo-stp_10.42.42.5(pid=28444) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:46:29.274667 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:46:29.303205 run osmo-hlr_10.42.42.2(pid=28441): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28441)] 04:46:29.353353 run osmo-hlr_10.42.42.2(pid=28441): stdout: | (launched: 2022-12-10_04:46:25.960477) 04:46:29.405566 run osmo-hlr_10.42.42.2(pid=28441): stderr: | 20221210044626160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044626160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044626160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044626160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044626160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044626160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044626172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044626180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044626181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044626181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:29.457865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Terminating (SIGTERM) 04:46:29.499785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Terminating (SIGTERM) 04:46:29.542223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28446): Terminating (SIGTERM) 04:46:29.584654 --- ParallelTerminationStrategy: PID 28440 died... 04:46:29.604579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Terminated: ok {rc=0} 04:46:29.651389 --- ParallelTerminationStrategy: PID 28443 died... 04:46:29.671329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Terminated: ok {rc=0} 04:46:29.717944 --- ParallelTerminationStrategy: PID 28446 died... 04:46:29.738058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28446): Terminated: ok {rc=0} 04:46:29.826348 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:46:31.148086 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:46:31.158534 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:46:31.201432 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:46:31.250758 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:46:31.354069 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:46:31.389789 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:46:31.430696 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:46:32.025056 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:46:32.092918 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.106651 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:46:32.159947 tst cs_paging_gprs_active.py: using LAC 26087 04:46:32.286928 tst cs_paging_gprs_active.py: using RAC 77 04:46:32.410663 tst cs_paging_gprs_active.py: using CellId 26087 04:46:32.534277 tst cs_paging_gprs_active.py: using BVCI 26088 04:46:32.649826 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.661877 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.673748 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.685899 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.698008 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.709865 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.721760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.733825 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:32.745861 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:46:32.861508 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:46:32.978270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:46:33.181317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:33.484270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28451): Launched 04:46:33.746551 run iperf3-srv_10.42.42.10(pid=28452): Launched 04:46:33.859824 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:46:34.061916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:34.364476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28453): Launched 04:46:34.626964 run iperf3-srv_10.42.42.10(pid=28454): Launched 04:46:34.739828 tst cs_paging_gprs_active.py:38: start network... 04:46:34.941849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:35.409895 run create_hlr_db(pid=28455): Launched 04:46:35.542438 bus /gobi_6: Setting Powered False 04:46:36.606062 run create_hlr_db(pid=28455): Terminated: ok {rc=0} 04:46:37.038618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28457): Launched 04:46:37.339821 run osmo-hlr_10.42.42.2(pid=28458): Launched 04:46:37.453739 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:37.987273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28460): Launched 04:46:38.287553 run osmo-stp_10.42.42.5(pid=28461): Launched 04:46:38.401005 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:38.920725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28463): Launched 04:46:39.035537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:39.290251 run patchelf(pid=28464): Launched 04:46:39.457692 run osmo-stp_10.42.42.5(pid=28461): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28461)] 04:46:39.585520 run osmo-stp_10.42.42.5(pid=28461): stdout: | (launched: 2022-12-10_04:46:38.232219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:39.715515 run osmo-stp_10.42.42.5(pid=28461): stderr: | 20221210044638402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044638402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044638402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044638403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044638405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044638405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044638405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:39.845336 run osmo-stp_10.42.42.5(pid=28461): stdout: | (launched: 2022-12-10_04:46:38.232219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:39.968818 run osmo-stp_10.42.42.5(pid=28461): stderr: | 20221210044638402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044638402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044638402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044638403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044638405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044638405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044638405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:40.115320 run patchelf(pid=28464): Terminating (SIGINT) 04:46:40.284584 run patchelf(pid=28464): Terminated: ok {rc=0} 04:46:40.406998 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28461): Process ended prematurely: osmo-stp_10.42.42.5(pid=28461) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28461)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:46:40.416710 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 04:46:40.444218 run osmo-hlr_10.42.42.2(pid=28458): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28458)] 04:46:40.492374 run osmo-hlr_10.42.42.2(pid=28458): stdout: | (launched: 2022-12-10_04:46:37.284587) 04:46:40.542040 run osmo-hlr_10.42.42.2(pid=28458): stderr: | 20221210044637463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044637463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044637463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044637463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044637463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044637463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044637475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044637484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044637484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044637484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:40.592214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28451): Terminating (SIGTERM) 04:46:40.631944 run iperf3-srv_10.42.42.10(pid=28452): Terminating (SIGTERM) 04:46:40.671777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28453): Terminating (SIGTERM) 04:46:40.711764 run iperf3-srv_10.42.42.10(pid=28454): Terminating (SIGTERM) 04:46:40.751336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28457): Terminating (SIGTERM) 04:46:40.791508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28460): Terminating (SIGTERM) 04:46:40.831395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28463): Terminating (SIGTERM) 04:46:40.871192 --- ParallelTerminationStrategy: PID 28451 died... 04:46:40.890087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28451): Terminated: ok {rc=0} 04:46:40.934626 --- ParallelTerminationStrategy: PID 28452 died... 04:46:40.953374 run iperf3-srv_10.42.42.10(pid=28452): Terminated {rc=256} 04:46:40.997387 --- ParallelTerminationStrategy: PID 28453 died... 04:46:41.015910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28453): Terminated: ok {rc=0} 04:46:41.060786 --- ParallelTerminationStrategy: PID 28454 died... 04:46:41.079487 run iperf3-srv_10.42.42.10(pid=28454): Terminated {rc=256} 04:46:41.123629 --- ParallelTerminationStrategy: PID 28457 died... 04:46:41.142182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28457): Terminated: ok {rc=0} 04:46:41.186270 --- ParallelTerminationStrategy: PID 28460 died... 04:46:41.205020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28460): Terminated: ok {rc=0} 04:46:41.249202 --- ParallelTerminationStrategy: PID 28463 died... 04:46:41.267675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28463): Terminated: ok {rc=0} 04:46:41.354682 bus /gobi_0: Setting Powered False 04:46:42.454505 bus /gobi_0: Setting Powered False 04:46:43.571332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:46:44.719685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:44.732182 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:46:44.784021 tst iperf3.py: using LAC 26088 04:46:44.911471 tst iperf3.py: using RAC 78 04:46:45.036864 tst iperf3.py: using CellId 26088 04:46:45.161619 tst iperf3.py: using BVCI 26089 04:46:45.277452 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.289537 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.301370 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.313229 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.325098 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.336882 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.348815 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.360469 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:45.372411 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:46:45.490739 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:46:45.706859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:46.035975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28465): Launched 04:46:46.331222 run iperf3-srv_10.42.42.10(pid=28466): Launched 04:46:46.461438 tst iperf3.py:8: start network... 04:46:46.681196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:47.186359 run create_hlr_db(pid=28467): Launched 04:46:47.318854 bus /gobi_6: Setting Powered False 04:46:48.383554 run create_hlr_db(pid=28467): Terminated: ok {rc=0} 04:46:48.812074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28469): Launched 04:46:49.111972 run osmo-hlr_10.42.42.2(pid=28470): Launched 04:46:49.226104 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:49.754966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28472): Launched 04:46:50.054950 run osmo-stp_10.42.42.5(pid=28473): Launched 04:46:50.168888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:50.700585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28475): Launched 04:46:50.815671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:51.070575 run patchelf(pid=28476): Launched 04:46:51.237472 run osmo-stp_10.42.42.5(pid=28473): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28473)] 04:46:51.365448 run osmo-stp_10.42.42.5(pid=28473): stdout: | (launched: 2022-12-10_04:46:49.999430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:51.495639 run osmo-stp_10.42.42.5(pid=28473): stderr: | 20221210044650169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044650169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044650170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044650170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044650170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044650170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044650171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:51.625503 run osmo-stp_10.42.42.5(pid=28473): stdout: | (launched: 2022-12-10_04:46:49.999430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:51.749181 run osmo-stp_10.42.42.5(pid=28473): stderr: | 20221210044650169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044650169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044650170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044650170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044650170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044650170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044650171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:51.895682 run patchelf(pid=28476): Terminating (SIGINT) 04:46:52.064633 run patchelf(pid=28476): Terminated: ok {rc=0} 04:46:52.187210 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28473): Process ended prematurely: osmo-stp_10.42.42.5(pid=28473) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28473)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:46:52.196940 tst iperf3.py:8: Test FAILED (7.5 sec) 04:46:52.225129 run osmo-hlr_10.42.42.2(pid=28470): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28470)] 04:46:52.272657 run osmo-hlr_10.42.42.2(pid=28470): stdout: | (launched: 2022-12-10_04:46:49.056538) 04:46:52.321803 run osmo-hlr_10.42.42.2(pid=28470): stderr: | 20221210044649233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044649233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044649233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044649233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044649233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044649233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044649244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044649254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044649254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044649254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:52.371548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28465): Terminating (SIGTERM) 04:46:52.410905 run iperf3-srv_10.42.42.10(pid=28466): Terminating (SIGTERM) 04:46:52.450759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28469): Terminating (SIGTERM) 04:46:52.490371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28472): Terminating (SIGTERM) 04:46:52.529811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28475): Terminating (SIGTERM) 04:46:52.569613 --- ParallelTerminationStrategy: PID 28465 died... 04:46:52.588331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28465): Terminated: ok {rc=0} 04:46:52.632185 --- ParallelTerminationStrategy: PID 28466 died... 04:46:52.650585 run iperf3-srv_10.42.42.10(pid=28466): Terminated {rc=256} 04:46:52.694383 --- ParallelTerminationStrategy: PID 28469 died... 04:46:52.712828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28469): Terminated: ok {rc=0} 04:46:52.756729 --- ParallelTerminationStrategy: PID 28472 died... 04:46:52.775208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28472): Terminated: ok {rc=0} 04:46:52.819274 --- ParallelTerminationStrategy: PID 28475 died... 04:46:52.837676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28475): Terminated: ok {rc=0} 04:46:52.923060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:46:54.073260 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.085839 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:46:54.145428 tst iperf3m4.py: using LAC 26089 04:46:54.270810 tst iperf3m4.py: using RAC 79 04:46:54.394989 tst iperf3m4.py: using CellId 26089 04:46:54.519667 tst iperf3m4.py: using BVCI 26090 04:46:54.637912 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.649804 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.661530 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.673853 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.686483 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.698124 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.710459 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.723018 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:46:54.734918 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:46:54.854936 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:46:54.972682 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:46:55.092548 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:46:55.209988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:46:55.429525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:55.752148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28477): Launched 04:46:56.031057 run iperf3-srv_10.42.42.10(pid=28478): Launched 04:46:56.151006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:46:56.367825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:56.690043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28479): Launched 04:46:56.968851 run iperf3-srv_10.42.42.10(pid=28480): Launched 04:46:57.088584 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:46:57.305440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:57.627530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28481): Launched 04:46:57.906597 run iperf3-srv_10.42.42.10(pid=28482): Launched 04:46:58.026077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:46:58.242638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:58.565180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28483): Launched 04:46:58.844536 run iperf3-srv_10.42.42.10(pid=28484): Launched 04:46:58.964167 tst iperf3m4.py:8: start network... 04:46:59.181216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:59.680381 run create_hlr_db(pid=28485): Launched 04:46:59.810047 bus /gobi_6: Setting Powered False 04:47:00.874824 run create_hlr_db(pid=28485): Terminated: ok {rc=0} 04:47:01.336658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28487): Launched 04:47:01.735145 run osmo-hlr_10.42.42.2(pid=28488): Launched 04:47:02.017704 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:02.658752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28490): Launched 04:47:02.962582 run osmo-stp_10.42.42.5(pid=28491): Launched 04:47:03.077046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:03.597899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28493): Launched 04:47:03.713232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:03.968720 run patchelf(pid=28494): Launched 04:47:04.136534 run osmo-stp_10.42.42.5(pid=28491): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28491)] 04:47:04.264554 run osmo-stp_10.42.42.5(pid=28491): stdout: | (launched: 2022-12-10_04:47:02.907112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:04.394378 run osmo-stp_10.42.42.5(pid=28491): stderr: | 20221210044703075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044703076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044703076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044703076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044703078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044703079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044703079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:04.524361 run osmo-stp_10.42.42.5(pid=28491): stdout: | (launched: 2022-12-10_04:47:02.907112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:04.648133 run osmo-stp_10.42.42.5(pid=28491): stderr: | 20221210044703075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044703076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044703076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044703076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044703078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044703079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044703079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:04.794675 run patchelf(pid=28494): Terminating (SIGINT) 04:47:04.963996 run patchelf(pid=28494): Terminated: ok {rc=0} 04:47:05.086745 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28491): Process ended prematurely: osmo-stp_10.42.42.5(pid=28491) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28491)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:47:05.096402 tst iperf3m4.py:8: Test FAILED (11.1 sec) 04:47:05.124320 run osmo-hlr_10.42.42.2(pid=28488): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28488)] 04:47:05.172396 run osmo-hlr_10.42.42.2(pid=28488): stdout: | (launched: 2022-12-10_04:47:01.667981) 04:47:05.221570 run osmo-hlr_10.42.42.2(pid=28488): stderr: | 20221210044701915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044701915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044701915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044701915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044701915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044701915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044701929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044701945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044701945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044701945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:05.271140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28477): Terminating (SIGTERM) 04:47:05.310963 run iperf3-srv_10.42.42.10(pid=28478): Terminating (SIGTERM) 04:47:05.350717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28479): Terminating (SIGTERM) 04:47:05.390439 run iperf3-srv_10.42.42.10(pid=28480): Terminating (SIGTERM) 04:47:05.430211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28481): Terminating (SIGTERM) 04:47:05.470037 run iperf3-srv_10.42.42.10(pid=28482): Terminating (SIGTERM) 04:47:05.509926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28483): Terminating (SIGTERM) 04:47:05.549749 run iperf3-srv_10.42.42.10(pid=28484): Terminating (SIGTERM) 04:47:05.589261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28487): Terminating (SIGTERM) 04:47:05.629248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28490): Terminating (SIGTERM) 04:47:05.668885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28493): Terminating (SIGTERM) 04:47:05.708777 --- ParallelTerminationStrategy: PID 28477 died... 04:47:05.727714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28477): Terminated: ok {rc=0} 04:47:05.772160 --- ParallelTerminationStrategy: PID 28478 died... 04:47:05.790673 run iperf3-srv_10.42.42.10(pid=28478): Terminated {rc=256} 04:47:05.835233 --- ParallelTerminationStrategy: PID 28479 died... 04:47:05.853878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28479): Terminated: ok {rc=0} 04:47:05.897842 --- ParallelTerminationStrategy: PID 28480 died... 04:47:05.916500 run iperf3-srv_10.42.42.10(pid=28480): Terminated {rc=256} 04:47:05.960277 --- ParallelTerminationStrategy: PID 28481 died... 04:47:05.978877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28481): Terminated: ok {rc=0} 04:47:06.022726 --- ParallelTerminationStrategy: PID 28482 died... 04:47:06.041288 run iperf3-srv_10.42.42.10(pid=28482): Terminated {rc=256} 04:47:06.085275 --- ParallelTerminationStrategy: PID 28483 died... 04:47:06.103857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28483): Terminated: ok {rc=0} 04:47:06.147756 --- ParallelTerminationStrategy: PID 28484 died... 04:47:06.166275 run iperf3-srv_10.42.42.10(pid=28484): Terminated {rc=256} 04:47:06.210260 --- ParallelTerminationStrategy: PID 28487 died... 04:47:06.228749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28487): Terminated: ok {rc=0} 04:47:06.272914 --- ParallelTerminationStrategy: PID 28490 died... 04:47:06.291816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28490): Terminated: ok {rc=0} 04:47:06.335927 --- ParallelTerminationStrategy: PID 28493 died... 04:47:06.354544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28493): Terminated: ok {rc=0} 04:47:06.439825 bus /gobi_4: Setting Powered False 04:47:07.539518 bus /gobi_4: Setting Powered False 04:47:08.652028 bus /gobi_1: Setting Powered False 04:47:09.749969 bus /gobi_1: Setting Powered False 04:47:10.865121 bus /gobi_0: Setting Powered False 04:47:11.960021 bus /gobi_0: Setting Powered False 04:47:13.075473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:47:14.178234 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.190522 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:14.240728 tst ping.py: using LAC 26090 04:47:14.356707 tst ping.py: using RAC 80 04:47:14.471668 tst ping.py: using CellId 26090 04:47:14.588821 tst ping.py: using BVCI 26091 04:47:14.704018 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.716306 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.728236 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.740424 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.752636 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.764462 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.776321 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:14.788009 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:14.903015 tst ping.py:19: start network... 04:47:15.101223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:15.560055 run create_hlr_db(pid=28496): Launched 04:47:15.673014 bus /gobi_6: Setting Powered False 04:47:16.753308 run create_hlr_db(pid=28496): Terminated: ok {rc=0} 04:47:17.241735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28498): Launched 04:47:17.544649 run osmo-hlr_10.42.42.2(pid=28499): Launched 04:47:17.657691 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:18.177478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28501): Launched 04:47:18.471167 run osmo-stp_10.42.42.5(pid=28502): Launched 04:47:18.583433 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:19.091755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28504): Launched 04:47:19.204796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:19.454227 run patchelf(pid=28505): Launched 04:47:19.618234 run osmo-stp_10.42.42.5(pid=28502): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28502)] 04:47:19.743637 run osmo-stp_10.42.42.5(pid=28502): stdout: | (launched: 2022-12-10_04:47:18.416773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:19.870310 run osmo-stp_10.42.42.5(pid=28502): stderr: | 20221210044718585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044718585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044718586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044718586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044718587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044718587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044718587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:19.997415 run osmo-stp_10.42.42.5(pid=28502): stdout: | (launched: 2022-12-10_04:47:18.416773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:20.118197 run osmo-stp_10.42.42.5(pid=28502): stderr: | 20221210044718585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044718585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044718586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044718586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044718587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044718587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044718587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:20.261321 run patchelf(pid=28505): Terminating (SIGINT) 04:47:20.426781 run patchelf(pid=28505): Terminated: ok {rc=0} 04:47:20.546205 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28502): Process ended prematurely: osmo-stp_10.42.42.5(pid=28502) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28502)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:47:20.555320 tst ping.py:22: Test FAILED (6.4 sec) 04:47:20.582560 run osmo-hlr_10.42.42.2(pid=28499): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28499)] 04:47:20.630176 run osmo-hlr_10.42.42.2(pid=28499): stdout: | (launched: 2022-12-10_04:47:17.489958) 04:47:20.679382 run osmo-hlr_10.42.42.2(pid=28499): stderr: | 20221210044717667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044717667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044717667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044717667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044717667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044717667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044717679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044717688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044717688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044717688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:20.729548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28498): Terminating (SIGTERM) 04:47:20.769365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28501): Terminating (SIGTERM) 04:47:20.809286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28504): Terminating (SIGTERM) 04:47:20.849137 --- ParallelTerminationStrategy: PID 28498 died... 04:47:20.868045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28498): Terminated: ok {rc=0} 04:47:20.912146 --- ParallelTerminationStrategy: PID 28501 died... 04:47:20.930817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28501): Terminated: ok {rc=0} 04:47:20.974872 --- ParallelTerminationStrategy: PID 28504 died... 04:47:20.993389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28504): Terminated: ok {rc=0} 04:47:21.076274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:47:22.161754 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.174921 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:22.227528 tst ping_idle_ping.py: using LAC 26091 04:47:22.350541 tst ping_idle_ping.py: using RAC 81 04:47:22.473082 tst ping_idle_ping.py: using CellId 26091 04:47:22.596024 tst ping_idle_ping.py: using BVCI 26092 04:47:22.705486 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.717170 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.728460 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.740799 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.752853 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.764922 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.777388 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:22.789417 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:22.908760 tst ping_idle_ping.py:24: start network... 04:47:23.108428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:23.570500 run create_hlr_db(pid=28506): Launched 04:47:23.684259 bus /gobi_6: Setting Powered False 04:47:24.743825 run create_hlr_db(pid=28506): Terminated: ok {rc=0} 04:47:25.178678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28508): Launched 04:47:25.495965 run osmo-hlr_10.42.42.2(pid=28509): Launched 04:47:25.616865 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:26.161689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28511): Launched 04:47:26.476474 run osmo-stp_10.42.42.5(pid=28512): Launched 04:47:26.597418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:27.142787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28514): Launched 04:47:27.262725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:27.529567 run patchelf(pid=28515): Launched 04:47:27.705072 run osmo-stp_10.42.42.5(pid=28512): ERR: Terminated: ERROR {rc=1} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28512)] 04:47:27.838812 run osmo-stp_10.42.42.5(pid=28512): stdout: | (launched: 2022-12-10_04:47:26.418582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:27.973310 run osmo-stp_10.42.42.5(pid=28512): stderr: | 20221210044726611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044726611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044726612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044726612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044726613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044726613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044726613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:28.108166 run osmo-stp_10.42.42.5(pid=28512): stdout: | (launched: 2022-12-10_04:47:26.418582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:28.237125 run osmo-stp_10.42.42.5(pid=28512): stderr: | 20221210044726611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044726611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044726612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044726612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044726613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044726613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044726613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:28.390053 run patchelf(pid=28515): Terminating (SIGINT) 04:47:28.566293 run patchelf(pid=28515): Terminated: ok {rc=0} 04:47:28.693826 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28512): Process ended prematurely: osmo-stp_10.42.42.5(pid=28512) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28512)] [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:47:28.703692 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:47:28.731840 run osmo-hlr_10.42.42.2(pid=28509): ERR: Terminated: ERROR {rc=237} [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28509)] 04:47:28.781955 run osmo-hlr_10.42.42.2(pid=28509): stdout: | (launched: 2022-12-10_04:47:25.437947) 04:47:28.833522 run osmo-hlr_10.42.42.2(pid=28509): stderr: | 20221210044725635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044725635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044725635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044725635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044725635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044725636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044725647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044725655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044725656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044725656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:28.885322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28508): Terminating (SIGTERM) 04:47:28.926492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28511): Terminating (SIGTERM) 04:47:28.967881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28514): Terminating (SIGTERM) 04:47:29.009424 --- ParallelTerminationStrategy: PID 28508 died... 04:47:29.029285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28508): Terminated: ok {rc=0} 04:47:29.075242 --- ParallelTerminationStrategy: PID 28511 died... 04:47:29.094652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28511): Terminated: ok {rc=0} 04:47:29.140391 --- ParallelTerminationStrategy: PID 28514 died... 04:47:29.159913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28514): Terminated: ok {rc=0} 04:47:29.246368 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 04:47:30.567691 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:47:30.575758 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:47:30.608676 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:47:30.644234 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:47:30.699501 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:47:30.732402 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:47:30.767732 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:47:31.326299 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2369 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:47:31.333673 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:31.346786 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:47:31.420092 tst switch_tch_pdch.py: using LAC 26092 04:47:31.539194 tst switch_tch_pdch.py: using RAC 82 04:47:31.698854 tst switch_tch_pdch.py: using CellId 26092 04:47:31.864170 tst switch_tch_pdch.py: using BVCI 26093 04:47:31.980892 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:31.993642 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:32.006208 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:32.018789 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:32.031374 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:32.043747 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:32.056350 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:47:32.069082 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:47:32.198162 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:47:32.316516 tst switch_tch_pdch.py:51: start network... 04:47:32.515812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:32.972799 run create_hlr_db(pid=28520): Launched 04:47:33.085337 bus /gobi_6: Setting Powered False 04:47:34.144823 run create_hlr_db(pid=28520): Terminated: ok {rc=0} 04:47:34.565359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28522): Launched 04:47:34.860281 run osmo-hlr_10.42.42.2(pid=28523): Launched 04:47:34.973331 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:35.494743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28525): Launched 04:47:35.790372 run osmo-stp_10.42.42.5(pid=28526): Launched 04:47:35.904741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:36.422328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28529): Launched 04:47:36.535262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:36.785512 run patchelf(pid=28530): Launched 04:47:36.949166 run osmo-stp_10.42.42.5(pid=28526): ERR: Terminated: ERROR {rc=1} [trial-2369↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28526)] 04:47:37.074696 run osmo-stp_10.42.42.5(pid=28526): stdout: | (launched: 2022-12-10_04:47:35.735625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:37.201577 run osmo-stp_10.42.42.5(pid=28526): stderr: | 20221210044735906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044735906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044735906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044735907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044735907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044735907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044735907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:37.328405 run osmo-stp_10.42.42.5(pid=28526): stdout: | (launched: 2022-12-10_04:47:35.735625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:37.449445 run osmo-stp_10.42.42.5(pid=28526): stderr: | 20221210044735906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044735906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044735906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044735907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044735907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044735907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044735907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:37.592757 run patchelf(pid=28530): Terminating (SIGINT) 04:47:37.758302 run patchelf(pid=28530): Terminated: ok {rc=0} 04:47:37.878261 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28526): Process ended prematurely: osmo-stp_10.42.42.5(pid=28526) [trial-2369↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28526)] [trial-2369↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:47:37.887279 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:47:37.913944 run osmo-hlr_10.42.42.2(pid=28523): ERR: Terminated: ERROR {rc=237} [trial-2369↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28523)] 04:47:37.961559 run osmo-hlr_10.42.42.2(pid=28523): stdout: | (launched: 2022-12-10_04:47:34.805939) 04:47:38.010833 run osmo-hlr_10.42.42.2(pid=28523): stderr: | 20221210044734981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044734981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044734981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044734981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044734981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044734981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044734993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044735003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044735003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044735003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:38.060453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28522): Terminating (SIGTERM) 04:47:38.100461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28525): Terminating (SIGTERM) 04:47:38.140250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28529): Terminating (SIGTERM) 04:47:38.180133 --- ParallelTerminationStrategy: PID 28522 died... 04:47:38.199092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28522): Terminated: ok {rc=0} 04:47:38.242807 --- ParallelTerminationStrategy: PID 28525 died... 04:47:38.261643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28525): Terminated: ok {rc=0} 04:47:38.305263 --- ParallelTerminationStrategy: PID 28529 died... 04:47:38.323743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28529): Terminated: ok {rc=0} 04:47:38.408722 bus /gobi_0: Setting Powered False 04:47:39.507432 bus /gobi_0: Setting Powered False 04:47:40.622988 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2369 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 nitb_smpp --------------------------------------------------------------------- 04:47:41.875166 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:47:41.877799 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 04:47:41.898061 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 04:47:41.905736 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 04:47:41.941604 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 04:47:41.963147 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 04:47:41.970330 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 04:47:42.486815 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2369 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 04:47:42.493358 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:47:42.512280 tst esme_connect_policy_acceptall.py: using MSISDN 7555 04:47:42.644641 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:47:43.208803 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28535): Launched 04:47:43.510865 run osmo-nitb_10.42.42.2(pid=28536): Launched 04:47:43.678133 run osmo-nitb_10.42.42.2(pid=28536): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28536)] 04:47:43.813907 run osmo-nitb_10.42.42.2(pid=28536): stdout: | (launched: 2022-12-10_04:47:43.455683) 04:47:43.951211 run osmo-nitb_10.42.42.2(pid=28536): stderr: | (launched: 2022-12-10_04:47:43.500454) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:44.088582 run osmo-nitb_10.42.42.2(pid=28536): stdout: | (launched: 2022-12-10_04:47:43.455683) 04:47:44.220300 run osmo-nitb_10.42.42.2(pid=28536): stderr: | (launched: 2022-12-10_04:47:43.500454) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28536) [trial-2369↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28536)] 04:47:44.625276 tst osmo-nitb_10.42.42.2(pid=28536): stdout: | (launched: 2022-12-10_04:47:43.455683) 04:47:44.747748 tst osmo-nitb_10.42.42.2(pid=28536): stderr: | (launched: 2022-12-10_04:47:43.500454) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:44.891922 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=28536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28536) [trial-2369↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28536)] [trial-2369↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 04:47:44.900616 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 04:47:44.907475 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28535): Terminating (SIGTERM) 04:47:45.116802 --- ParallelTerminationStrategy: PID 28535 died... 04:47:45.137205 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28535): Terminated: ok {rc=0} ---------------------------------------------- trial-2369 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 04:47:45.185974 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:47:45.207034 tst esme_connect_policy_closed.py: using MSISDN 7556 04:47:45.336584 tst esme_connect_policy_closed.py: using MSISDN 7557 04:47:45.447630 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:47:46.027464 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28537): Launched 04:47:46.414471 run osmo-nitb_10.42.42.2(pid=28538): Launched 04:47:46.592138 run osmo-nitb_10.42.42.2(pid=28538): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28538)] 04:47:46.720036 run osmo-nitb_10.42.42.2(pid=28538): stdout: | (launched: 2022-12-10_04:47:46.343556) 04:47:46.849549 run osmo-nitb_10.42.42.2(pid=28538): stderr: | (launched: 2022-12-10_04:47:46.389392) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:46.979717 run osmo-nitb_10.42.42.2(pid=28538): stdout: | (launched: 2022-12-10_04:47:46.343556) 04:47:47.104085 run osmo-nitb_10.42.42.2(pid=28538): stderr: | (launched: 2022-12-10_04:47:46.389392) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:47.252587 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=28538): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28538) [trial-2369↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28538)] [trial-2369↪nitb_smpp↪esme_connect_policy_closed.py:24] 04:47:47.261318 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 04:47:47.268038 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28537): Terminating (SIGTERM) 04:47:47.477193 --- ParallelTerminationStrategy: PID 28537 died... 04:47:47.497351 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28537): Terminated: ok {rc=0} ---------------------------------------------- trial-2369 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 04:47:47.545715 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:47:47.556711 tst nitb_smpp: Using 1 x bts (candidates: 1) 04:47:47.592757 tst esme_ms_sms_storeforward.py: using LAC 26093 04:47:47.712257 tst esme_ms_sms_storeforward.py: using RAC 83 04:47:47.830868 tst esme_ms_sms_storeforward.py: using CellId 26093 04:47:47.950654 tst esme_ms_sms_storeforward.py: using BVCI 26094 04:47:48.060869 tst nitb_smpp: Using 1 x modem (candidates: 1) 04:47:48.184833 tst esme_ms_sms_storeforward.py: using MSISDN 7558 04:47:48.296711 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 04:47:48.501994 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:47:49.122152 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28539): Launched 04:47:49.428029 run osmo-nitb_10.42.42.2(pid=28540): Launched 04:47:49.592840 run osmo-nitb_10.42.42.2(pid=28540): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28540)] 04:47:49.718789 run osmo-nitb_10.42.42.2(pid=28540): stdout: | (launched: 2022-12-10_04:47:49.371926) 04:47:49.846429 run osmo-nitb_10.42.42.2(pid=28540): stderr: | (launched: 2022-12-10_04:47:49.417238) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:49.974122 run osmo-nitb_10.42.42.2(pid=28540): stdout: | (launched: 2022-12-10_04:47:49.371926) 04:47:50.095778 run osmo-nitb_10.42.42.2(pid=28540): stderr: | (launched: 2022-12-10_04:47:49.417238) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:50.241603 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=28540): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28540) [trial-2369↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28540)] [trial-2369↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 04:47:50.250172 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 04:47:50.256707 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28539): Terminating (SIGTERM) 04:47:50.465494 --- ParallelTerminationStrategy: PID 28539 died... 04:47:50.486343 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28539): Terminated: ok {rc=0} 04:47:50.571975 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 04:47:51.661403 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:47:51.673312 tst nitb_smpp: Using 1 x bts (candidates: 1) 04:47:51.730553 tst esme_ms_sms_transaction.py: using LAC 26094 04:47:51.859969 tst esme_ms_sms_transaction.py: using RAC 84 04:47:51.978098 tst esme_ms_sms_transaction.py: using CellId 26094 04:47:52.095789 tst esme_ms_sms_transaction.py: using BVCI 26095 04:47:52.205926 tst nitb_smpp: Using 1 x modem (candidates: 1) 04:47:52.332190 tst esme_ms_sms_transaction.py: using MSISDN 7559 04:47:52.443321 tst esme_ms_sms_transaction.py:18: start nitb and bts... 04:47:52.647780 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:47:53.262566 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28541): Launched 04:47:53.565659 run osmo-nitb_10.42.42.2(pid=28542): Launched 04:47:53.732917 run osmo-nitb_10.42.42.2(pid=28542): ERR: Terminated: ERROR {rc=2} [trial-2369↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28542)] 04:47:53.869378 run osmo-nitb_10.42.42.2(pid=28542): stdout: | (launched: 2022-12-10_04:47:53.509916) 04:47:54.007357 run osmo-nitb_10.42.42.2(pid=28542): stderr: | (launched: 2022-12-10_04:47:53.554922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:54.144919 run osmo-nitb_10.42.42.2(pid=28542): stdout: | (launched: 2022-12-10_04:47:53.509916) 04:47:54.276933 run osmo-nitb_10.42.42.2(pid=28542): stderr: | (launched: 2022-12-10_04:47:53.554922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f633f900268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28542): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28542) [trial-2369↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28542)] 04:47:54.680011 tst osmo-nitb_10.42.42.2(pid=28542): stdout: | (launched: 2022-12-10_04:47:53.509916) 04:47:54.803159 tst osmo-nitb_10.42.42.2(pid=28542): stderr: | (launched: 2022-12-10_04:47:53.554922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:47:54.947496 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=28542): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28542) [trial-2369↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28542)] [trial-2369↪nitb_smpp↪esme_ms_sms_transaction.py:21] 04:47:54.956205 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 04:47:54.962947 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28541): Terminating (SIGTERM) 04:47:55.172273 --- ParallelTerminationStrategy: PID 28541 died... 04:47:55.192729 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28541): Terminated: ok {rc=0} 04:47:55.278318 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 smpp --------------------------------------------------------------------- 04:47:56.448660 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:47:56.451623 tst smpp: Verifying 1 x bts (candidates: 11) 04:47:56.472721 tst smpp: Verifying 6 x ip_address (candidates: 9) 04:47:56.500280 tst smpp: Verifying 1 x modem (candidates: 12) 04:47:56.536452 tst smpp: Reserving 1 x bts (candidates: 11) 04:47:56.557165 tst smpp: Reserving 6 x ip_address (candidates: 9) 04:47:56.584738 tst smpp: Reserving 1 x modem (candidates: 12) 04:47:57.110997 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 04:47:57.116179 tst smpp: Using 1 x ip_address (candidates: 6) 04:47:57.126786 tst smpp: Using 1 x ip_address (candidates: 6) 04:47:57.137759 tst smpp: Using 1 x ip_address (candidates: 6) 04:47:57.148943 tst smpp: Using 1 x ip_address (candidates: 6) 04:47:57.167749 tst esme_connect_policy_acceptall.py: using MSISDN 7560 04:47:57.281305 run osmo-stp_10.42.42.4: Starting osmo-stp 04:47:57.797586 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28546): Launched 04:47:58.102085 run osmo-stp_10.42.42.4(pid=28547): Launched 04:47:58.217943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:58.687164 run create_hlr_db(pid=28548): Launched 04:47:58.801496 bus /sierra_2: Setting Powered False 04:47:59.861687 run create_hlr_db(pid=28548): Terminated: ok {rc=0} 04:48:00.301709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28550): Launched 04:48:00.623333 run osmo-hlr_10.42.42.2(pid=28551): Launched 04:48:00.746546 run osmo-msc_10.42.42.5: Starting osmo-msc 04:48:01.417897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28553): Launched 04:48:01.759690 run osmo-msc_10.42.42.5(pid=28554): Launched 04:48:02.065927 run osmo-hlr_10.42.42.2(pid=28551): ERR: Terminated: ERROR {rc=237} [trial-2369↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28551)] 04:48:02.319947 run osmo-hlr_10.42.42.2(pid=28551): stdout: | (launched: 2022-12-10_04:48:00.564228) 04:48:02.472461 run osmo-hlr_10.42.42.2(pid=28551): stderr: | 20221210044800762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044800762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044800775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044800783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044800784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044800784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:02.608739 run osmo-hlr_10.42.42.2(pid=28551): stdout: | (launched: 2022-12-10_04:48:00.564228) 04:48:02.737771 run osmo-hlr_10.42.42.2(pid=28551): stderr: | 20221210044800762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044800762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044800762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044800775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044800783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044800784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044800784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:02.892544 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=28551): Process ended prematurely: osmo-hlr_10.42.42.2(pid=28551) [trial-2369↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28551)] [trial-2369↪smpp↪esme_connect_policy_acceptall.py:23] 04:48:02.901619 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.8 sec) 04:48:02.929218 run osmo-msc_10.42.42.5(pid=28554): ERR: Terminated: ERROR {rc=9} [trial-2369↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=28554)] 04:48:02.979630 run osmo-msc_10.42.42.5(pid=28554): stdout: | (launched: 2022-12-10_04:48:01.688331) 04:48:03.031167 run osmo-msc_10.42.42.5(pid=28554): stderr: | 20221210044802226 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210044802226 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210044802226 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044802226 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210044802226 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210044802227 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210044802227 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210044802227 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210044802227 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 04:48:03.083127 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28546): Terminating (SIGTERM) 04:48:03.124662 run osmo-stp_10.42.42.4(pid=28547): Terminating (SIGTERM) 04:48:03.166166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28550): Terminating (SIGTERM) 04:48:03.208570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28553): Terminating (SIGTERM) 04:48:03.251218 --- ParallelTerminationStrategy: PID 28546 died... 04:48:03.271594 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28546): Terminated: ok {rc=0} 04:48:03.319204 --- ParallelTerminationStrategy: PID 28550 died... 04:48:03.338906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28550): Terminated: ok {rc=0} 04:48:03.385141 --- ParallelTerminationStrategy: PID 28547 died... 04:48:03.404529 run osmo-stp_10.42.42.4(pid=28547): Terminated: ok {rc=0} 04:48:03.450514 --- ParallelTerminationStrategy: PID 28553 died... 04:48:03.469908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28553): Terminated: ok {rc=0} ---------------------------------------------- trial-2369 smpp esme_connect_policy_closed.py ---------------------------------------------- 04:48:03.520773 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:03.532352 tst smpp: Using 1 x bts (candidates: 1) 04:48:03.568713 tst esme_connect_policy_closed.py: using LAC 26095 04:48:03.695819 tst esme_connect_policy_closed.py: using RAC 85 04:48:03.822587 tst esme_connect_policy_closed.py: using CellId 26095 04:48:03.950700 tst esme_connect_policy_closed.py: using BVCI 26096 04:48:04.069487 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:04.080461 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:04.091293 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:04.111694 tst esme_connect_policy_closed.py: using MSISDN 7561 04:48:04.239945 tst esme_connect_policy_closed.py: using MSISDN 7562 04:48:04.356667 run osmo-stp_10.42.42.4: Starting osmo-stp 04:48:04.907837 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28557): Launched 04:48:05.231554 run osmo-stp_10.42.42.4(pid=28558): Launched 04:48:05.355117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:05.858411 run create_hlr_db(pid=28559): Launched 04:48:07.048396 run create_hlr_db(pid=28559): Terminated: ok {rc=0} 04:48:07.389721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28561): Launched 04:48:07.713271 run osmo-hlr_10.42.42.2(pid=28562): Launched 04:48:07.837383 run osmo-msc_10.42.42.5: Starting osmo-msc 04:48:08.425444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28564): Launched 04:48:08.748410 run osmo-msc_10.42.42.5(pid=28565): Launched 04:48:08.929320 run osmo-hlr_10.42.42.2(pid=28562): ERR: Terminated: ERROR {rc=237} [trial-2369↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28562)] 04:48:09.067159 run osmo-hlr_10.42.42.2(pid=28562): stdout: | (launched: 2022-12-10_04:48:07.654318) 04:48:09.204278 run osmo-hlr_10.42.42.2(pid=28562): stderr: | 20221210044807851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044807851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044807864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044807872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044807873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044807873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:09.340741 run osmo-hlr_10.42.42.2(pid=28562): stdout: | (launched: 2022-12-10_04:48:07.654318) 04:48:09.470121 run osmo-hlr_10.42.42.2(pid=28562): stderr: | 20221210044807851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044807851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044807851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044807864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044807872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044807873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044807873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:09.624340 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=28562): Process ended prematurely: osmo-hlr_10.42.42.2(pid=28562) [trial-2369↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28562)] [trial-2369↪smpp↪esme_connect_policy_closed.py:31] 04:48:09.633577 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 04:48:09.660798 run osmo-msc_10.42.42.5(pid=28565): ERR: Terminated: ERROR {rc=9} [trial-2369↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=28565)] 04:48:09.710724 run osmo-msc_10.42.42.5(pid=28565): stdout: | (launched: 2022-12-10_04:48:08.689385) 04:48:09.762215 run osmo-msc_10.42.42.5(pid=28565): stderr: | 20221210044809055 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210044809055 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210044809055 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044809055 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210044809055 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210044809055 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210044809056 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210044809056 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210044809056 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 04:48:09.814198 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28557): Terminating (SIGTERM) 04:48:09.855447 run osmo-stp_10.42.42.4(pid=28558): Terminating (SIGTERM) 04:48:09.896933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28561): Terminating (SIGTERM) 04:48:09.939746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28564): Terminating (SIGTERM) 04:48:09.984259 --- ParallelTerminationStrategy: PID 28557 died... 04:48:10.004873 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28557): Terminated: ok {rc=0} 04:48:10.052169 --- ParallelTerminationStrategy: PID 28558 died... 04:48:10.071620 run osmo-stp_10.42.42.4(pid=28558): Terminated: ok {rc=0} 04:48:10.117291 --- ParallelTerminationStrategy: PID 28561 died... 04:48:10.136707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28561): Terminated: ok {rc=0} 04:48:10.182594 --- ParallelTerminationStrategy: PID 28564 died... 04:48:10.202173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28564): Terminated: ok {rc=0} ---------------------------------------------- trial-2369 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 04:48:10.252731 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:10.264217 tst smpp: Using 1 x bts (candidates: 1) 04:48:10.302430 tst esme_ms_sms_storeforward.py: using LAC 26096 04:48:10.430493 tst esme_ms_sms_storeforward.py: using RAC 86 04:48:10.558064 tst esme_ms_sms_storeforward.py: using CellId 26096 04:48:10.678825 tst esme_ms_sms_storeforward.py: using BVCI 26097 04:48:10.792455 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:10.803126 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:10.813682 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:10.824826 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:10.836129 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:10.847426 tst smpp: Using 1 x modem (candidates: 1) 04:48:10.978322 tst esme_ms_sms_storeforward.py: using MSISDN 7563 04:48:11.098694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:11.603340 run create_hlr_db(pid=28568): Launched 04:48:12.793143 run create_hlr_db(pid=28568): Terminated: ok {rc=0} 04:48:13.136076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28570): Launched 04:48:13.461480 run osmo-hlr_10.42.42.2(pid=28571): Launched 04:48:13.586180 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:14.153132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28573): Launched 04:48:14.478228 run osmo-stp_10.42.42.5(pid=28574): Launched 04:48:14.602720 run osmo-msc_10.42.42.6: Starting osmo-msc 04:48:15.189851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28576): Launched 04:48:15.514435 run osmo-msc_10.42.42.6(pid=28577): Launched 04:48:15.695040 run osmo-stp_10.42.42.5(pid=28574): ERR: Terminated: ERROR {rc=1} [trial-2369↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28574)] 04:48:15.836485 run osmo-stp_10.42.42.5(pid=28574): stdout: | (launched: 2022-12-10_04:48:14.418857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:16.075358 run osmo-stp_10.42.42.5(pid=28574): stderr: | 20221210044814613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044814613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044814613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044814614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044814614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044814614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044814614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:16.215405 run osmo-stp_10.42.42.5(pid=28574): stdout: | (launched: 2022-12-10_04:48:14.418857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:16.341178 run osmo-stp_10.42.42.5(pid=28574): stderr: | 20221210044814613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044814613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044814613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044814614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044814614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044814614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044814614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:16.493839 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=28574): Process ended prematurely: osmo-stp_10.42.42.5(pid=28574) [trial-2369↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28574)] [trial-2369↪smpp↪esme_ms_sms_storeforward.py:30] 04:48:16.503391 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 04:48:16.533435 run osmo-hlr_10.42.42.2(pid=28571): ERR: Terminated: ERROR {rc=237} [trial-2369↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28571)] 04:48:16.584776 run osmo-hlr_10.42.42.2(pid=28571): stdout: | (launched: 2022-12-10_04:48:13.402048) 04:48:16.639516 run osmo-hlr_10.42.42.2(pid=28571): stderr: | 20221210044813599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044813599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044813600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044813600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044813600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044813600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044813613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044813622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044813622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044813622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:16.713046 run osmo-msc_10.42.42.6(pid=28577): ERR: Terminated: ERROR {rc=2} [trial-2369↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28577)] 04:48:16.763782 run osmo-msc_10.42.42.6(pid=28577): stdout: | (launched: 2022-12-10_04:48:15.454894) 04:48:16.816746 run osmo-msc_10.42.42.6(pid=28577): stderr: | 20221210044815778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044815778 DLGLOBAL DEBUG validating counter group 0x7f7cc622cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044815778 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044815779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044815779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044815779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044815781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044815781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044815782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044815782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:48:16.869956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28570): Terminating (SIGTERM) 04:48:16.913290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28573): Terminating (SIGTERM) 04:48:16.957750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28576): Terminating (SIGTERM) 04:48:17.002301 --- ParallelTerminationStrategy: PID 28570 died... 04:48:17.023894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28570): Terminated: ok {rc=0} 04:48:17.073283 --- ParallelTerminationStrategy: PID 28573 died... 04:48:17.092909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28573): Terminated: ok {rc=0} 04:48:17.141141 --- ParallelTerminationStrategy: PID 28576 died... 04:48:17.160917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28576): Terminated: ok {rc=0} 04:48:17.250517 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 smpp esme_ms_sms_transaction.py ---------------------------------------------- 04:48:18.338604 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:18.350254 tst smpp: Using 1 x bts (candidates: 1) 04:48:18.387377 tst esme_ms_sms_transaction.py: using LAC 26097 04:48:18.516771 tst esme_ms_sms_transaction.py: using RAC 87 04:48:18.643400 tst esme_ms_sms_transaction.py: using CellId 26097 04:48:18.772329 tst esme_ms_sms_transaction.py: using BVCI 26098 04:48:18.884516 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:18.895254 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:18.905727 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:18.916445 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:18.926992 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:18.937627 tst smpp: Using 1 x modem (candidates: 1) 04:48:19.066729 tst esme_ms_sms_transaction.py: using MSISDN 7564 04:48:19.184381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:19.686633 run create_hlr_db(pid=28579): Launched 04:48:19.818513 bus /sierra_2: Setting Powered False 04:48:20.882412 run create_hlr_db(pid=28579): Terminated: ok {rc=0} 04:48:21.321875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28581): Launched 04:48:21.627738 run osmo-hlr_10.42.42.2(pid=28582): Launched 04:48:21.743915 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:22.282553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28584): Launched 04:48:22.586221 run osmo-stp_10.42.42.5(pid=28585): Launched 04:48:22.702028 run osmo-msc_10.42.42.6: Starting osmo-msc 04:48:23.253362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28587): Launched 04:48:23.558302 run osmo-msc_10.42.42.6(pid=28588): Launched 04:48:23.728707 run osmo-stp_10.42.42.5(pid=28585): ERR: Terminated: ERROR {rc=1} [trial-2369↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28585)] 04:48:23.858179 run osmo-stp_10.42.42.5(pid=28585): stdout: | (launched: 2022-12-10_04:48:22.530335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:23.987695 run osmo-stp_10.42.42.5(pid=28585): stderr: | 20221210044822703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044822703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044822704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044822704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044822704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044822705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044822705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:24.115285 run osmo-stp_10.42.42.5(pid=28585): stdout: | (launched: 2022-12-10_04:48:22.530335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:24.237631 run osmo-stp_10.42.42.5(pid=28585): stderr: | 20221210044822703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044822703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044822704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044822704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044822704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044822705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044822705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:24.383158 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=28585): Process ended prematurely: osmo-stp_10.42.42.5(pid=28585) [trial-2369↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28585)] [trial-2369↪smpp↪esme_ms_sms_transaction.py:28] 04:48:24.391683 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 04:48:24.417992 run osmo-hlr_10.42.42.2(pid=28582): ERR: Terminated: ERROR {rc=237} [trial-2369↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28582)] 04:48:24.465879 run osmo-hlr_10.42.42.2(pid=28582): stdout: | (launched: 2022-12-10_04:48:21.571654) 04:48:24.515377 run osmo-hlr_10.42.42.2(pid=28582): stderr: | 20221210044821749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044821749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044821749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044821750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044821750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044821750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044821762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044821771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044821771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044821772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:24.584063 run osmo-msc_10.42.42.6(pid=28588): ERR: Terminated: ERROR {rc=2} [trial-2369↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28588)] 04:48:24.631599 run osmo-msc_10.42.42.6(pid=28588): stdout: | (launched: 2022-12-10_04:48:23.502054) 04:48:24.680888 run osmo-msc_10.42.42.6(pid=28588): stderr: | 20221210044823775 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044823775 DLGLOBAL DEBUG validating counter group 0x7f483c941c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044823775 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044823775 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044823775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044823775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044823777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044823778 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044823778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044823778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:48:24.730864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28581): Terminating (SIGTERM) 04:48:24.770772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28584): Terminating (SIGTERM) 04:48:24.810902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28587): Terminating (SIGTERM) 04:48:24.850972 --- ParallelTerminationStrategy: PID 28581 died... 04:48:24.870189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28581): Terminated: ok {rc=0} 04:48:24.914823 --- ParallelTerminationStrategy: PID 28584 died... 04:48:24.933439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28584): Terminated: ok {rc=0} 04:48:24.977706 --- ParallelTerminationStrategy: PID 28587 died... 04:48:24.996344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28587): Terminated: ok {rc=0} 04:48:25.080476 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 encryption --------------------------------------------------------------------- 04:48:26.277070 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:48:26.280096 tst encryption: Verifying 1 x bts (candidates: 11) 04:48:26.301798 tst encryption: Verifying 6 x ip_address (candidates: 9) 04:48:26.329541 tst encryption: Verifying 1 x modem (candidates: 12) 04:48:26.364349 tst encryption: Reserving 1 x bts (candidates: 11) 04:48:26.385462 tst encryption: Reserving 6 x ip_address (candidates: 9) 04:48:26.412159 tst encryption: Reserving 1 x modem (candidates: 12) 04:48:26.944809 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2369 encryption register_a5_0_authopt.py ---------------------------------------------- 04:48:26.999144 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:27.010606 tst encryption: Using 1 x bts (candidates: 1) 04:48:27.044390 tst register_a5_0_authopt.py: using LAC 26098 04:48:27.165703 tst register_a5_0_authopt.py: using RAC 88 04:48:27.289444 tst register_a5_0_authopt.py: using CellId 26098 04:48:27.418305 tst register_a5_0_authopt.py: using BVCI 26099 04:48:27.537912 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:27.549087 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:27.560252 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:27.571432 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:27.582663 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:27.593882 tst encryption: Using 1 x modem (candidates: 1) 04:48:27.710017 tst register_a5_0_authopt.py:8: start network... 04:48:27.918426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:28.396707 run create_hlr_db(pid=28593): Launched 04:48:28.515325 bus /sierra_2: Setting Powered False 04:48:29.576585 run create_hlr_db(pid=28593): Terminated: ok {rc=0} 04:48:30.026017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28595): Launched 04:48:30.354776 run osmo-hlr_10.42.42.2(pid=28596): Launched 04:48:30.479651 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:31.061777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28598): Launched 04:48:31.386990 run osmo-stp_10.42.42.5(pid=28599): Launched 04:48:31.620061 run osmo-msc_10.42.42.6: Starting osmo-msc 04:48:32.250830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28601): Launched 04:48:32.583749 run osmo-msc_10.42.42.6(pid=28602): Launched 04:48:32.769472 run osmo-stp_10.42.42.5(pid=28599): ERR: Terminated: ERROR {rc=1} [trial-2369↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28599)] 04:48:32.907325 run osmo-stp_10.42.42.5(pid=28599): stdout: | (launched: 2022-12-10_04:48:31.324741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:33.045079 run osmo-stp_10.42.42.5(pid=28599): stderr: | 20221210044831660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044831660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044831669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044831670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044831670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044831670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044831670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:33.182268 run osmo-stp_10.42.42.5(pid=28599): stdout: | (launched: 2022-12-10_04:48:31.324741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:33.313091 run osmo-stp_10.42.42.5(pid=28599): stderr: | 20221210044831660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044831660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044831669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044831670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044831670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044831670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044831670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:33.469807 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28599): Process ended prematurely: osmo-stp_10.42.42.5(pid=28599) [trial-2369↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28599)] [trial-2369↪encryption↪register_a5_0_authopt.py:8] 04:48:33.479687 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 04:48:33.507994 run osmo-hlr_10.42.42.2(pid=28596): ERR: Terminated: ERROR {rc=237} [trial-2369↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28596)] 04:48:33.558097 run osmo-hlr_10.42.42.2(pid=28596): stdout: | (launched: 2022-12-10_04:48:30.294748) 04:48:33.609936 run osmo-hlr_10.42.42.2(pid=28596): stderr: | 20221210044830493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044830493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044830493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044830493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044830493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044830493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044830506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044830514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044830514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044830514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:33.681902 run osmo-msc_10.42.42.6(pid=28602): ERR: Terminated: ERROR {rc=2} [trial-2369↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28602)] 04:48:33.731781 run osmo-msc_10.42.42.6(pid=28602): stdout: | (launched: 2022-12-10_04:48:32.523517) 04:48:33.783272 run osmo-msc_10.42.42.6(pid=28602): stderr: | 20221210044832848 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044832849 DLGLOBAL DEBUG validating counter group 0x7f785460dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044832849 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044832849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044832849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044832849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044832851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044832851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044832851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044832851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:48:33.835046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28595): Terminating (SIGTERM) 04:48:33.876582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28598): Terminating (SIGTERM) 04:48:33.918417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28601): Terminating (SIGTERM) 04:48:33.960544 --- ParallelTerminationStrategy: PID 28595 died... 04:48:33.980580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28595): Terminated: ok {rc=0} 04:48:34.027085 --- ParallelTerminationStrategy: PID 28598 died... 04:48:34.046757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28598): Terminated: ok {rc=0} 04:48:34.093051 --- ParallelTerminationStrategy: PID 28601 died... 04:48:34.112750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28601): Terminated: ok {rc=0} 04:48:34.200226 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 encryption register_a5_0_authreq.py ---------------------------------------------- 04:48:35.348864 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:35.360001 tst encryption: Using 1 x bts (candidates: 1) 04:48:35.397101 tst register_a5_0_authreq.py: using LAC 26099 04:48:35.526956 tst register_a5_0_authreq.py: using RAC 89 04:48:35.657429 tst register_a5_0_authreq.py: using CellId 26099 04:48:35.783416 tst register_a5_0_authreq.py: using BVCI 26100 04:48:35.895890 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:35.906504 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:35.917089 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:35.927644 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:35.938279 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:35.948816 tst encryption: Using 1 x modem (candidates: 1) 04:48:36.068328 tst register_a5_0_authreq.py:8: start network... 04:48:36.292361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:36.800921 run create_hlr_db(pid=28604): Launched 04:48:36.934098 bus /sierra_2: Setting Powered False 04:48:37.998889 run create_hlr_db(pid=28604): Terminated: ok {rc=0} 04:48:38.440130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28606): Launched 04:48:38.749806 run osmo-hlr_10.42.42.2(pid=28607): Launched 04:48:38.866965 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:39.412011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28609): Launched 04:48:39.741625 run osmo-stp_10.42.42.5(pid=28610): Launched 04:48:39.866625 run osmo-msc_10.42.42.6: Starting osmo-msc 04:48:40.460721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28612): Launched 04:48:40.790322 run osmo-msc_10.42.42.6(pid=28613): Launched 04:48:40.972710 run osmo-stp_10.42.42.5(pid=28610): ERR: Terminated: ERROR {rc=1} [trial-2369↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28610)] 04:48:41.113891 run osmo-stp_10.42.42.5(pid=28610): stdout: | (launched: 2022-12-10_04:48:39.681741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:41.252140 run osmo-stp_10.42.42.5(pid=28610): stderr: | 20221210044839875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044839875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044839875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044839875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044839876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044839876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044839876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:41.390522 run osmo-stp_10.42.42.5(pid=28610): stdout: | (launched: 2022-12-10_04:48:39.681741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:41.521617 run osmo-stp_10.42.42.5(pid=28610): stderr: | 20221210044839875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044839875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044839875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044839875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044839876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044839876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044839876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:41.678680 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28610): Process ended prematurely: osmo-stp_10.42.42.5(pid=28610) [trial-2369↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28610)] [trial-2369↪encryption↪register_a5_0_authreq.py:8] 04:48:41.688604 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 04:48:41.717303 run osmo-hlr_10.42.42.2(pid=28607): ERR: Terminated: ERROR {rc=237} [trial-2369↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28607)] 04:48:41.767983 run osmo-hlr_10.42.42.2(pid=28607): stdout: | (launched: 2022-12-10_04:48:38.693197) 04:48:41.820687 run osmo-hlr_10.42.42.2(pid=28607): stderr: | 20221210044838869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044838869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044838869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044838869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044838869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044838870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044838881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044838890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044838890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044838890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:41.893587 run osmo-msc_10.42.42.6(pid=28613): ERR: Terminated: ERROR {rc=2} [trial-2369↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28613)] 04:48:41.944061 run osmo-msc_10.42.42.6(pid=28613): stdout: | (launched: 2022-12-10_04:48:40.729798) 04:48:41.996084 run osmo-msc_10.42.42.6(pid=28613): stderr: | 20221210044841055 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044841055 DLGLOBAL DEBUG validating counter group 0x7f1efb55fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044841055 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044841055 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044841055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044841056 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044841057 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044841058 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044841058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044841058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:48:42.048128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28606): Terminating (SIGTERM) 04:48:42.090269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28609): Terminating (SIGTERM) 04:48:42.132165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28612): Terminating (SIGTERM) 04:48:42.174124 --- ParallelTerminationStrategy: PID 28606 died... 04:48:42.194178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28606): Terminated: ok {rc=0} 04:48:42.241027 --- ParallelTerminationStrategy: PID 28609 died... 04:48:42.260885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28609): Terminated: ok {rc=0} 04:48:42.307407 --- ParallelTerminationStrategy: PID 28612 died... 04:48:42.327103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28612): Terminated: ok {rc=0} 04:48:42.415879 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 encryption register_a5_1_authreq.py ---------------------------------------------- 04:48:43.567807 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:43.579596 tst encryption: Using 1 x bts (candidates: 1) 04:48:43.617090 tst register_a5_1_authreq.py: using LAC 26100 04:48:43.745753 tst register_a5_1_authreq.py: using RAC 90 04:48:43.874958 tst register_a5_1_authreq.py: using CellId 26100 04:48:44.004564 tst register_a5_1_authreq.py: using BVCI 26101 04:48:44.123846 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:44.135117 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:44.146124 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:44.157198 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:44.168060 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:44.178935 tst encryption: Using 1 x modem (candidates: 1) 04:48:44.293446 tst register_a5_1_authreq.py:8: start network... 04:48:44.503238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:44.981427 run create_hlr_db(pid=28615): Launched 04:48:45.099944 bus /sierra_2: Setting Powered False 04:48:46.178122 run create_hlr_db(pid=28615): Terminated: ok {rc=0} 04:48:46.668098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28617): Launched 04:48:47.013454 run osmo-hlr_10.42.42.2(pid=28618): Launched 04:48:47.230552 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:47.763662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28620): Launched 04:48:48.073373 run osmo-stp_10.42.42.5(pid=28621): Launched 04:48:48.190580 run osmo-msc_10.42.42.6: Starting osmo-msc 04:48:48.747139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28623): Launched 04:48:49.056244 run osmo-msc_10.42.42.6(pid=28624): Launched 04:48:49.228759 run osmo-stp_10.42.42.5(pid=28621): ERR: Terminated: ERROR {rc=1} [trial-2369↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28621)] 04:48:49.360507 run osmo-stp_10.42.42.5(pid=28621): stdout: | (launched: 2022-12-10_04:48:48.016493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:49.492104 run osmo-stp_10.42.42.5(pid=28621): stderr: | 20221210044848189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044848189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044848190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044848190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044848190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044848191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044848191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:49.621178 run osmo-stp_10.42.42.5(pid=28621): stdout: | (launched: 2022-12-10_04:48:48.016493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:49.744640 run osmo-stp_10.42.42.5(pid=28621): stderr: | 20221210044848189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044848189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044848190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044848190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044848190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044848191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044848191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:49.892792 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28621): Process ended prematurely: osmo-stp_10.42.42.5(pid=28621) [trial-2369↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28621)] [trial-2369↪encryption↪register_a5_1_authreq.py:8] 04:48:49.901898 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 04:48:49.928927 run osmo-hlr_10.42.42.2(pid=28618): ERR: Terminated: ERROR {rc=237} [trial-2369↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28618)] 04:48:49.976800 run osmo-hlr_10.42.42.2(pid=28618): stdout: | (launched: 2022-12-10_04:48:46.952360) 04:48:50.026543 run osmo-hlr_10.42.42.2(pid=28618): stderr: | 20221210044847233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044847233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044847233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044847234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044847234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044847234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044847246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044847256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044847257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044847257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:50.096417 run osmo-msc_10.42.42.6(pid=28624): ERR: Terminated: ERROR {rc=2} [trial-2369↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28624)] 04:48:50.144409 run osmo-msc_10.42.42.6(pid=28624): stdout: | (launched: 2022-12-10_04:48:48.999326) 04:48:50.194283 run osmo-msc_10.42.42.6(pid=28624): stderr: | 20221210044849273 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044849273 DLGLOBAL DEBUG validating counter group 0x7f2b6a45bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044849273 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044849273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044849273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044849273 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044849275 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044849275 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044849275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044849276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:48:50.244381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28617): Terminating (SIGTERM) 04:48:50.284517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28620): Terminating (SIGTERM) 04:48:50.325121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28623): Terminating (SIGTERM) 04:48:50.366059 --- ParallelTerminationStrategy: PID 28617 died... 04:48:50.385216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28617): Terminated: ok {rc=0} 04:48:50.430045 --- ParallelTerminationStrategy: PID 28620 died... 04:48:50.448634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28620): Terminated: ok {rc=0} 04:48:50.493360 --- ParallelTerminationStrategy: PID 28623 died... 04:48:50.512058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28623): Terminated: ok {rc=0} 04:48:50.598857 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2369 encryption register_a5_3_authreq.py ---------------------------------------------- 04:48:51.747732 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:51.758845 tst encryption: Using 1 x bts (candidates: 1) 04:48:51.794297 tst register_a5_3_authreq.py: using LAC 26101 04:48:51.916865 tst register_a5_3_authreq.py: using RAC 91 04:48:52.039379 tst register_a5_3_authreq.py: using CellId 26101 04:48:52.161364 tst register_a5_3_authreq.py: using BVCI 26102 04:48:52.273291 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:52.283785 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:52.294293 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:52.304847 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:52.315542 tst encryption: Using 1 x ip_address (candidates: 6) 04:48:52.326128 tst encryption: Using 1 x modem (candidates: 1) 04:48:52.455624 tst register_a5_3_authreq.py:8: start network... 04:48:52.680024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:53.189288 run create_hlr_db(pid=28626): Launched 04:48:53.322686 bus /sierra_2: Setting Powered False 04:48:54.388247 run create_hlr_db(pid=28626): Terminated: ok {rc=0} 04:48:54.844364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28628): Launched 04:48:55.172772 run osmo-hlr_10.42.42.2(pid=28629): Launched 04:48:55.298271 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:55.866322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28631): Launched 04:48:56.194205 run osmo-stp_10.42.42.5(pid=28632): Launched 04:48:56.319114 run osmo-msc_10.42.42.6: Starting osmo-msc 04:48:56.912648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28634): Launched 04:48:57.239998 run osmo-msc_10.42.42.6(pid=28635): Launched 04:48:57.422481 run osmo-stp_10.42.42.5(pid=28632): ERR: Terminated: ERROR {rc=1} [trial-2369↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28632)] 04:48:57.560337 run osmo-stp_10.42.42.5(pid=28632): stdout: | (launched: 2022-12-10_04:48:56.134702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:57.698528 run osmo-stp_10.42.42.5(pid=28632): stderr: | 20221210044856329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044856329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044856329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044856330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044856330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044856330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044856330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:57.835195 run osmo-stp_10.42.42.5(pid=28632): stdout: | (launched: 2022-12-10_04:48:56.134702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:57.965624 run osmo-stp_10.42.42.5(pid=28632): stderr: | 20221210044856329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210044856329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210044856329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210044856330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210044856330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210044856330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210044856330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:58.121985 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28632): Process ended prematurely: osmo-stp_10.42.42.5(pid=28632) [trial-2369↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28632)] [trial-2369↪encryption↪register_a5_3_authreq.py:8] 04:48:58.131885 tst register_a5_3_authreq.py:8: Test FAILED (6.4 sec) 04:48:58.159595 run osmo-hlr_10.42.42.2(pid=28629): ERR: Terminated: ERROR {rc=237} [trial-2369↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28629)] 04:48:58.209100 run osmo-hlr_10.42.42.2(pid=28629): stdout: | (launched: 2022-12-10_04:48:55.112844) 04:48:58.260234 run osmo-hlr_10.42.42.2(pid=28629): stderr: | 20221210044855313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210044855313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210044855313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210044855313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210044855313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210044855313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210044855326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210044855334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210044855334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210044855334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:58.331604 run osmo-msc_10.42.42.6(pid=28635): ERR: Terminated: ERROR {rc=2} [trial-2369↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28635)] 04:48:58.381269 run osmo-msc_10.42.42.6(pid=28635): stdout: | (launched: 2022-12-10_04:48:57.180301) 04:48:58.432683 run osmo-msc_10.42.42.6(pid=28635): stderr: | 20221210044857503 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210044857503 DLGLOBAL DEBUG validating counter group 0x7f344937bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210044857503 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210044857503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210044857503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210044857503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210044857505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210044857506 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210044857506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210044857506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:48:58.483955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28628): Terminating (SIGTERM) 04:48:58.525148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28631): Terminating (SIGTERM) 04:48:58.566735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28634): Terminating (SIGTERM) 04:48:58.608175 --- ParallelTerminationStrategy: PID 28628 died... 04:48:58.628061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28628): Terminated: ok {rc=0} 04:48:58.673765 --- ParallelTerminationStrategy: PID 28631 died... 04:48:58.693236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28631): Terminated: ok {rc=0} 04:48:58.738640 --- ParallelTerminationStrategy: PID 28634 died... 04:48:58.758024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28634): Terminated: ok {rc=0} 04:48:58.843987 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 04:49:00.054716 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:49:00.060283 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 04:49:00.078771 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 04:49:00.106519 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 04:49:00.134069 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 04:49:00.152615 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 04:49:00.179073 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 04:49:00.689638 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 04:49:00.694197 tst handover.py:11: TEST_CONFIG: {} 04:49:00.907668 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:49:00.935271 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:49:00.959249 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:49:01.010959 tst handover.py: using MSISDN 7565 04:49:01.134650 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7565', subscriber_id=0} 04:49:01.252621 run srsepc_10.42.42.118: Starting srsepc 04:49:03.198081 run rm-remote-dir(pid=28640): Launched 04:49:03.329418 bus /sierra_2: Setting Powered False 04:49:04.398542 run rm-remote-dir(pid=28640): Terminated: ok {rc=0} 04:49:04.867759 run mk-remote-dir(pid=28641): Launched 04:49:06.058462 run mk-remote-dir(pid=28641): Terminated: ok {rc=0} 04:49:06.363511 run scp-inst-to-remote(pid=28642): Launched 04:49:08.553403 run scp-inst-to-remote(pid=28642): Terminated: ok {rc=0} 04:49:08.909715 run rm-remote-dir(pid=28644): Launched 04:49:10.099596 run rm-remote-dir(pid=28644): Terminated: ok {rc=0} 04:49:10.456443 run mk-remote-dir(pid=28645): Launched 04:49:11.648776 run mk-remote-dir(pid=28645): Terminated: ok {rc=0} 04:49:11.957409 run scp-cfg-to-remote(pid=28646): Launched 04:49:13.145126 run scp-cfg-to-remote(pid=28646): Terminated: ok {rc=0} 04:49:13.447185 run scp-db-to-remote(pid=28648): Launched 04:49:14.636130 run scp-db-to-remote(pid=28648): Terminated: ok {rc=0} 04:49:14.775949 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:49:15.104389 run patchelf(pid=28650): Launched 04:49:16.289229 run patchelf(pid=28650): Terminated: ok {rc=0} 04:49:16.425329 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:49:16.782005 run setcap-netadm(pid=28651): Launched 04:49:18.034859 run setcap-netadm(pid=28651): Terminated: ok {rc=0} 04:49:18.359316 run srsepc(pid=28652): Launched 04:49:18.473123 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:49:19.581383 run rm-remote-dir(pid=28653): Launched 04:49:19.756539 run srsepc(pid=28652): ERR: Terminated: ERROR {rc=127} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28652)] 04:49:19.890876 run srsepc(pid=28652): stdout: | (launched: 2022-12-10_04:49:18.302823) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:49:20.026611 run srsepc(pid=28652): stderr: | (launched: 2022-12-10_04:49:18.348566) | Connection to 10.42.42.116 closed. 04:49:20.162075 run srsepc(pid=28652): stdout: | (launched: 2022-12-10_04:49:18.302823) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:49:20.292164 run srsepc(pid=28652): stderr: | (launched: 2022-12-10_04:49:18.348566) | Connection to 10.42.42.116 closed. 04:49:20.445389 run rm-remote-dir(pid=28653): Terminating (SIGINT) 04:49:20.624246 run rm-remote-dir(pid=28653): Terminated: ok {rc=0} 04:49:20.752709 tst handover.py:37: ERR: Error: srsepc(pid=28652): Process ended prematurely: srsepc(pid=28652) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28652)] [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 04:49:20.762908 tst handover.py:37: Test FAILED (20.1 sec) 04:49:20.840210 run scp-back-log(pid=28654): Launched 04:49:21.916780 run scp-back-log(pid=28654): ERR: Terminated: ERROR {rc=1} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28654)] 04:49:21.977865 run scp-back-log(pid=28654): stdout: | (launched: 2022-12-10_04:49:20.809782) 04:49:22.040130 run scp-back-log(pid=28654): stderr: | (launched: 2022-12-10_04:49:20.829450) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:49:22.109917 tst srsepc_10.42.42.118: Error('scp-back-log(pid=28654): launch_sync(): local process exited with status 1 [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28654)]') ---------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 04:49:22.154772 tst iperf3_bidir.py:13: Number of physical ue: 1 04:49:22.361097 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:49:22.403334 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 04:49:22.609925 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:49:22.625672 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:49:22.657310 tst iperf3_bidir.py: using MSISDN 7566 04:49:22.775923 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7566', subscriber_id=0} 04:49:22.891359 run srsepc_10.42.42.118: Starting srsepc 04:49:23.560842 run rm-remote-dir(pid=28656): Launched 04:49:24.751890 run rm-remote-dir(pid=28656): Terminated: ok {rc=0} 04:49:25.110096 run mk-remote-dir(pid=28657): Launched 04:49:26.299945 run mk-remote-dir(pid=28657): Terminated: ok {rc=0} 04:49:26.605449 run scp-inst-to-remote(pid=28658): Launched 04:49:28.794441 run scp-inst-to-remote(pid=28658): Terminated: ok {rc=0} 04:49:29.150880 run rm-remote-dir(pid=28660): Launched 04:49:30.341731 run rm-remote-dir(pid=28660): Terminated: ok {rc=0} 04:49:30.700089 run mk-remote-dir(pid=28661): Launched 04:49:31.891191 run mk-remote-dir(pid=28661): Terminated: ok {rc=0} 04:49:32.205615 run scp-cfg-to-remote(pid=28662): Launched 04:49:33.398441 run scp-cfg-to-remote(pid=28662): Terminated: ok {rc=0} 04:49:33.702232 run scp-db-to-remote(pid=28664): Launched 04:49:34.891207 run scp-db-to-remote(pid=28664): Terminated: ok {rc=0} 04:49:35.031455 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:49:35.359723 run patchelf(pid=28667): Launched 04:49:36.547965 run patchelf(pid=28667): Terminated: ok {rc=0} 04:49:36.687665 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:49:37.017284 run setcap-netadm(pid=28668): Launched 04:49:38.204919 run setcap-netadm(pid=28668): Terminated: ok {rc=0} 04:49:38.548555 run srsepc(pid=28669): Launched 04:49:38.670881 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:49:39.849312 run rm-remote-dir(pid=28670): Launched 04:49:40.038839 run srsepc(pid=28669): ERR: Terminated: ERROR {rc=127} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28669)] 04:49:40.183408 run srsepc(pid=28669): stdout: | (launched: 2022-12-10_04:49:38.488679) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:49:40.327915 run srsepc(pid=28669): stderr: | (launched: 2022-12-10_04:49:38.537464) | Connection to 10.42.42.116 closed. 04:49:40.472483 run srsepc(pid=28669): stdout: | (launched: 2022-12-10_04:49:38.488679) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:49:40.610508 run srsepc(pid=28669): stderr: | (launched: 2022-12-10_04:49:38.537464) | Connection to 10.42.42.116 closed. 04:49:40.774502 run rm-remote-dir(pid=28670): Terminating (SIGINT) 04:49:40.963965 run rm-remote-dir(pid=28670): Terminated: ok {rc=0} 04:49:41.101172 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=28669): Process ended prematurely: srsepc(pid=28669) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28669)] [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 04:49:41.112474 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 04:49:41.193674 run scp-back-log(pid=28671): Launched 04:49:42.274465 run scp-back-log(pid=28671): ERR: Terminated: ERROR {rc=1} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28671)] 04:49:42.338746 run scp-back-log(pid=28671): stdout: | (launched: 2022-12-10_04:49:41.161731) 04:49:42.404179 run scp-back-log(pid=28671): stderr: | (launched: 2022-12-10_04:49:41.182409) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:49:42.477834 tst srsepc_10.42.42.118: Error('scp-back-log(pid=28671): launch_sync(): local process exited with status 1 [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28671)]') ---------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 04:49:42.525699 tst iperf3_dl.py:13: Number of physical ue: 1 04:49:42.746908 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:49:42.792159 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 04:49:43.013112 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:49:43.029770 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:49:43.062744 tst iperf3_dl.py: using MSISDN 7567 04:49:43.181247 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7567', subscriber_id=0} 04:49:43.296098 run srsepc_10.42.42.118: Starting srsepc 04:49:43.965094 run rm-remote-dir(pid=28673): Launched 04:49:45.155890 run rm-remote-dir(pid=28673): Terminated: ok {rc=0} 04:49:45.513028 run mk-remote-dir(pid=28674): Launched 04:49:46.716412 run mk-remote-dir(pid=28674): Terminated: ok {rc=0} 04:49:47.071451 run scp-inst-to-remote(pid=28675): Launched 04:49:49.313824 run scp-inst-to-remote(pid=28675): Terminated: ok {rc=0} 04:49:49.648586 run rm-remote-dir(pid=28677): Launched 04:49:50.827233 run rm-remote-dir(pid=28677): Terminated: ok {rc=0} 04:49:51.163814 run mk-remote-dir(pid=28678): Launched 04:49:52.342663 run mk-remote-dir(pid=28678): Terminated: ok {rc=0} 04:49:52.629374 run scp-cfg-to-remote(pid=28679): Launched 04:49:53.805945 run scp-cfg-to-remote(pid=28679): Terminated: ok {rc=0} 04:49:54.090813 run scp-db-to-remote(pid=28681): Launched 04:49:55.270649 run scp-db-to-remote(pid=28681): Terminated: ok {rc=0} 04:49:55.411138 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:49:55.740372 run patchelf(pid=28683): Launched 04:49:56.928586 run patchelf(pid=28683): Terminated: ok {rc=0} 04:49:57.068352 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:49:57.397413 run setcap-netadm(pid=28684): Launched 04:49:58.585406 run setcap-netadm(pid=28684): Terminated: ok {rc=0} 04:49:58.930017 run srsepc(pid=28685): Launched 04:49:59.052305 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:00.230500 run rm-remote-dir(pid=28686): Launched 04:50:00.419176 run srsepc(pid=28685): ERR: Terminated: ERROR {rc=127} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28685)] 04:50:00.562779 run srsepc(pid=28685): stdout: | (launched: 2022-12-10_04:49:58.869852) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:00.706487 run srsepc(pid=28685): stderr: | (launched: 2022-12-10_04:49:58.918864) | Connection to 10.42.42.116 closed. 04:50:00.854452 run srsepc(pid=28685): stdout: | (launched: 2022-12-10_04:49:58.869852) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:01.006060 run srsepc(pid=28685): stderr: | (launched: 2022-12-10_04:49:58.918864) | Connection to 10.42.42.116 closed. 04:50:01.216137 run rm-remote-dir(pid=28686): Terminating (SIGINT) 04:50:01.457140 run rm-remote-dir(pid=28686): Terminated: ok {rc=0} 04:50:01.614728 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=28685): Process ended prematurely: srsepc(pid=28685) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28685)] [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 04:50:01.625955 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 04:50:01.713862 run scp-back-log(pid=28690): Launched 04:50:02.829778 run scp-back-log(pid=28690): ERR: Terminated: ERROR {rc=1} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28690)] 04:50:02.893886 run scp-back-log(pid=28690): stdout: | (launched: 2022-12-10_04:50:01.675259) 04:50:02.959275 run scp-back-log(pid=28690): stderr: | (launched: 2022-12-10_04:50:01.696282) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:50:03.032202 tst srsepc_10.42.42.118: Error('scp-back-log(pid=28690): launch_sync(): local process exited with status 1 [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28690)]') ---------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 04:50:03.079321 tst iperf3_ul.py:13: Number of physical ue: 1 04:50:03.299633 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:03.342528 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 04:50:03.560671 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:03.577151 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:03.609344 tst iperf3_ul.py: using MSISDN 7568 04:50:03.727444 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7568', subscriber_id=0} 04:50:03.842330 run srsepc_10.42.42.118: Starting srsepc 04:50:04.511439 run rm-remote-dir(pid=28692): Launched 04:50:05.702498 run rm-remote-dir(pid=28692): Terminated: ok {rc=0} 04:50:06.060084 run mk-remote-dir(pid=28693): Launched 04:50:07.251396 run mk-remote-dir(pid=28693): Terminated: ok {rc=0} 04:50:07.555343 run scp-inst-to-remote(pid=28694): Launched 04:50:09.743425 run scp-inst-to-remote(pid=28694): Terminated: ok {rc=0} 04:50:10.099332 run rm-remote-dir(pid=28696): Launched 04:50:11.288694 run rm-remote-dir(pid=28696): Terminated: ok {rc=0} 04:50:11.646506 run mk-remote-dir(pid=28697): Launched 04:50:12.837939 run mk-remote-dir(pid=28697): Terminated: ok {rc=0} 04:50:13.143007 run scp-cfg-to-remote(pid=28698): Launched 04:50:14.332091 run scp-cfg-to-remote(pid=28698): Terminated: ok {rc=0} 04:50:14.634387 run scp-db-to-remote(pid=28700): Launched 04:50:15.823166 run scp-db-to-remote(pid=28700): Terminated: ok {rc=0} 04:50:15.988244 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:16.369735 run patchelf(pid=28702): Launched 04:50:17.573482 run patchelf(pid=28702): Terminated: ok {rc=0} 04:50:17.713162 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:18.042078 run setcap-netadm(pid=28703): Launched 04:50:19.229757 run setcap-netadm(pid=28703): Terminated: ok {rc=0} 04:50:19.573270 run srsepc(pid=28704): Launched 04:50:19.695447 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:20.872071 run rm-remote-dir(pid=28705): Launched 04:50:21.061340 run srsepc(pid=28704): ERR: Terminated: ERROR {rc=127} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28704)] 04:50:21.206106 run srsepc(pid=28704): stdout: | (launched: 2022-12-10_04:50:19.513547) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:21.351062 run srsepc(pid=28704): stderr: | (launched: 2022-12-10_04:50:19.561987) | Connection to 10.42.42.116 closed. 04:50:21.495944 run srsepc(pid=28704): stdout: | (launched: 2022-12-10_04:50:19.513547) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:21.634681 run srsepc(pid=28704): stderr: | (launched: 2022-12-10_04:50:19.561987) | Connection to 10.42.42.116 closed. 04:50:21.799006 run rm-remote-dir(pid=28705): Terminating (SIGINT) 04:50:21.989096 run rm-remote-dir(pid=28705): Terminated: ok {rc=0} 04:50:22.125409 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=28704): Process ended prematurely: srsepc(pid=28704) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28704)] [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 04:50:22.136292 tst iperf3_ul.py:42: Test FAILED (19.0 sec) 04:50:22.217909 run scp-back-log(pid=28706): Launched 04:50:23.299825 run scp-back-log(pid=28706): ERR: Terminated: ERROR {rc=1} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28706)] 04:50:23.363688 run scp-back-log(pid=28706): stdout: | (launched: 2022-12-10_04:50:22.185088) 04:50:23.428776 run scp-back-log(pid=28706): stderr: | (launched: 2022-12-10_04:50:22.205845) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:50:23.501936 tst srsepc_10.42.42.118: Error('scp-back-log(pid=28706): launch_sync(): local process exited with status 1 [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28706)]') ---------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 04:50:23.549611 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:23.566866 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:23.590406 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:23.639557 tst ping.py: using MSISDN 7569 04:50:23.754591 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7569', subscriber_id=0} 04:50:23.862883 run srsepc_10.42.42.118: Starting srsepc 04:50:24.493864 run rm-remote-dir(pid=28708): Launched 04:50:25.673189 run rm-remote-dir(pid=28708): Terminated: ok {rc=0} 04:50:26.009394 run mk-remote-dir(pid=28709): Launched 04:50:27.187001 run mk-remote-dir(pid=28709): Terminated: ok {rc=0} 04:50:27.472908 run scp-inst-to-remote(pid=28710): Launched 04:50:29.656267 run scp-inst-to-remote(pid=28710): Terminated: ok {rc=0} 04:50:30.012091 run rm-remote-dir(pid=28712): Launched 04:50:31.201688 run rm-remote-dir(pid=28712): Terminated: ok {rc=0} 04:50:31.605703 run mk-remote-dir(pid=28713): Launched 04:50:32.870508 run mk-remote-dir(pid=28713): Terminated: ok {rc=0} 04:50:33.174770 run scp-cfg-to-remote(pid=28714): Launched 04:50:34.363385 run scp-cfg-to-remote(pid=28714): Terminated: ok {rc=0} 04:50:34.665541 run scp-db-to-remote(pid=28716): Launched 04:50:35.853513 run scp-db-to-remote(pid=28716): Terminated: ok {rc=0} 04:50:35.992893 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:36.321138 run patchelf(pid=28718): Launched 04:50:37.507418 run patchelf(pid=28718): Terminated: ok {rc=0} 04:50:37.646614 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:37.974898 run setcap-netadm(pid=28719): Launched 04:50:39.162641 run setcap-netadm(pid=28719): Terminated: ok {rc=0} 04:50:39.506076 run srsepc(pid=28720): Launched 04:50:39.627319 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:40.808139 run rm-remote-dir(pid=28721): Launched 04:50:40.997924 run srsepc(pid=28720): ERR: Terminated: ERROR {rc=127} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28720)] 04:50:41.142312 run srsepc(pid=28720): stdout: | (launched: 2022-12-10_04:50:39.446295) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:41.287371 run srsepc(pid=28720): stderr: | (launched: 2022-12-10_04:50:39.494827) | Connection to 10.42.42.116 closed. 04:50:41.431907 run srsepc(pid=28720): stdout: | (launched: 2022-12-10_04:50:39.446295) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:41.569919 run srsepc(pid=28720): stderr: | (launched: 2022-12-10_04:50:39.494827) | Connection to 10.42.42.116 closed. 04:50:41.733250 run rm-remote-dir(pid=28721): Terminating (SIGINT) 04:50:41.923239 run rm-remote-dir(pid=28721): Terminated: ok {rc=0} 04:50:42.060175 tst ping.py:16: ERR: Error: srsepc(pid=28720): Process ended prematurely: srsepc(pid=28720) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28720)] [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 04:50:42.071105 tst ping.py:16: Test FAILED (18.5 sec) 04:50:42.151518 run scp-back-log(pid=28722): Launched 04:50:43.231561 run scp-back-log(pid=28722): ERR: Terminated: ERROR {rc=1} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28722)] 04:50:43.294910 run scp-back-log(pid=28722): stdout: | (launched: 2022-12-10_04:50:42.119708) 04:50:43.359736 run scp-back-log(pid=28722): stderr: | (launched: 2022-12-10_04:50:42.140286) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:50:43.432580 tst srsepc_10.42.42.118: Error('scp-back-log(pid=28722): launch_sync(): local process exited with status 1 [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28722)]') ---------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 04:50:43.480054 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:43.497264 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:43.520552 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:43.571041 tst rrc_idle_mo_ping.py: using MSISDN 7570 04:50:43.692284 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7570', subscriber_id=0} 04:50:43.806457 run srsepc_10.42.42.118: Starting srsepc 04:50:44.475150 run rm-remote-dir(pid=28724): Launched 04:50:45.666106 run rm-remote-dir(pid=28724): Terminated: ok {rc=0} 04:50:46.055914 run mk-remote-dir(pid=28725): Launched 04:50:47.284286 run mk-remote-dir(pid=28725): Terminated: ok {rc=0} 04:50:47.572808 run scp-inst-to-remote(pid=28726): Launched 04:50:49.754553 run scp-inst-to-remote(pid=28726): Terminated: ok {rc=0} 04:50:50.110873 run rm-remote-dir(pid=28728): Launched 04:50:51.301598 run rm-remote-dir(pid=28728): Terminated: ok {rc=0} 04:50:51.659197 run mk-remote-dir(pid=28729): Launched 04:50:52.850550 run mk-remote-dir(pid=28729): Terminated: ok {rc=0} 04:50:53.155209 run scp-cfg-to-remote(pid=28730): Launched 04:50:54.342395 run scp-cfg-to-remote(pid=28730): Terminated: ok {rc=0} 04:50:54.645634 run scp-db-to-remote(pid=28732): Launched 04:50:55.830818 run scp-db-to-remote(pid=28732): Terminated: ok {rc=0} 04:50:55.962767 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:56.272554 run patchelf(pid=28734): Launched 04:50:57.449162 run patchelf(pid=28734): Terminated: ok {rc=0} 04:50:57.580876 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:57.890242 run setcap-netadm(pid=28735): Launched 04:50:59.066343 run setcap-netadm(pid=28735): Terminated: ok {rc=0} 04:50:59.391884 run srsepc(pid=28736): Launched 04:50:59.505677 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:00.615904 run rm-remote-dir(pid=28737): Launched 04:51:00.792096 run srsepc(pid=28736): ERR: Terminated: ERROR {rc=127} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28736)] 04:51:00.971828 run srsepc(pid=28736): stdout: | (launched: 2022-12-10_04:50:59.334260) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:01.155434 run srsepc(pid=28736): stderr: | (launched: 2022-12-10_04:50:59.380738) | Connection to 10.42.42.116 closed. 04:51:01.298698 run srsepc(pid=28736): stdout: | (launched: 2022-12-10_04:50:59.334260) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:01.431852 run srsepc(pid=28736): stderr: | (launched: 2022-12-10_04:50:59.380738) | Connection to 10.42.42.116 closed. 04:51:01.589256 run rm-remote-dir(pid=28737): Terminating (SIGINT) 04:51:01.771168 run rm-remote-dir(pid=28737): Terminated: ok {rc=0} 04:51:01.903686 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=28736): Process ended prematurely: srsepc(pid=28736) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28736)] [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 04:51:01.915087 tst rrc_idle_mo_ping.py:16: Test FAILED (18.4 sec) 04:51:02.004721 run scp-back-log(pid=28738): Launched 04:51:03.114480 run scp-back-log(pid=28738): ERR: Terminated: ERROR {rc=1} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28738)] 04:51:03.174938 run scp-back-log(pid=28738): stdout: | (launched: 2022-12-10_04:51:01.965449) 04:51:03.236495 run scp-back-log(pid=28738): stderr: | (launched: 2022-12-10_04:51:01.985487) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:03.305806 tst srsepc_10.42.42.118: Error('scp-back-log(pid=28738): launch_sync(): local process exited with status 1 [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28738)]') ---------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 04:51:03.351233 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:51:03.367789 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:51:03.391714 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:51:03.454410 tst rrc_idle_mt_ping.py: using MSISDN 7571 04:51:03.567846 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7571', subscriber_id=0} 04:51:03.675918 run srsepc_10.42.42.118: Starting srsepc 04:51:04.305892 run rm-remote-dir(pid=28742): Launched 04:51:05.484599 run rm-remote-dir(pid=28742): Terminated: ok {rc=0} 04:51:05.822208 run mk-remote-dir(pid=28743): Launched 04:51:06.999967 run mk-remote-dir(pid=28743): Terminated: ok {rc=0} 04:51:07.288181 run scp-inst-to-remote(pid=28744): Launched 04:51:09.467094 run scp-inst-to-remote(pid=28744): Terminated: ok {rc=0} 04:51:09.802519 run rm-remote-dir(pid=28746): Launched 04:51:10.982832 run rm-remote-dir(pid=28746): Terminated: ok {rc=0} 04:51:11.320499 run mk-remote-dir(pid=28747): Launched 04:51:12.499533 run mk-remote-dir(pid=28747): Terminated: ok {rc=0} 04:51:12.787366 run scp-cfg-to-remote(pid=28748): Launched 04:51:13.963679 run scp-cfg-to-remote(pid=28748): Terminated: ok {rc=0} 04:51:14.249174 run scp-db-to-remote(pid=28750): Launched 04:51:15.425383 run scp-db-to-remote(pid=28750): Terminated: ok {rc=0} 04:51:15.558167 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:51:15.892454 run patchelf(pid=28752): Launched 04:51:17.178088 run patchelf(pid=28752): Terminated: ok {rc=0} 04:51:17.314727 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:51:17.629121 run setcap-netadm(pid=28753): Launched 04:51:18.805798 run setcap-netadm(pid=28753): Terminated: ok {rc=0} 04:51:19.130763 run srsepc(pid=28754): Launched 04:51:19.244205 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:20.352931 run rm-remote-dir(pid=28755): Launched 04:51:20.528878 run srsepc(pid=28754): ERR: Terminated: ERROR {rc=127} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28754)] 04:51:20.663542 run srsepc(pid=28754): stdout: | (launched: 2022-12-10_04:51:19.073670) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:20.799065 run srsepc(pid=28754): stderr: | (launched: 2022-12-10_04:51:19.119173) | Connection to 10.42.42.116 closed. 04:51:20.934682 run srsepc(pid=28754): stdout: | (launched: 2022-12-10_04:51:19.073670) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:21.064246 run srsepc(pid=28754): stderr: | (launched: 2022-12-10_04:51:19.119173) | Connection to 10.42.42.116 closed. 04:51:21.217376 run rm-remote-dir(pid=28755): Terminating (SIGINT) 04:51:21.394858 run rm-remote-dir(pid=28755): Terminated: ok {rc=0} 04:51:21.523975 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=28754): Process ended prematurely: srsepc(pid=28754) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28754)] [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 04:51:21.534388 tst rrc_idle_mt_ping.py:16: Test FAILED (18.2 sec) 04:51:21.612125 run scp-back-log(pid=28756): Launched 04:51:22.689367 run scp-back-log(pid=28756): ERR: Terminated: ERROR {rc=1} [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28756)] 04:51:22.750044 run scp-back-log(pid=28756): stdout: | (launched: 2022-12-10_04:51:21.581551) 04:51:22.812384 run scp-back-log(pid=28756): stderr: | (launched: 2022-12-10_04:51:21.601319) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:22.882414 tst srsepc_10.42.42.118: Error('scp-back-log(pid=28756): launch_sync(): local process exited with status 1 [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=28756)]') --------------------------------------------------------------------- trial-2369 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 04:51:23.011036 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:51:23.016332 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 04:51:23.057985 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 04:51:23.084736 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 04:51:23.138288 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 04:51:23.181147 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 04:51:23.207793 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 04:51:23.754259 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 04:51:23.759491 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:51:23.770450 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 04:51:23.808031 tst handover.py: using LAC 26102 04:51:23.929283 tst handover.py: using RAC 92 04:51:24.048587 tst handover.py: using CellId 26102 04:51:24.168840 tst handover.py: using BVCI 26103 04:51:24.278400 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 04:51:24.318049 tst handover.py: using LAC 26103 04:51:24.436555 tst handover.py: using RAC 93 04:51:24.554447 tst handover.py: using CellId 26103 04:51:24.674008 tst handover.py: using BVCI 26104 04:51:24.783815 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:51:24.794716 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:51:24.805489 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:51:24.816932 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:51:24.828406 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:51:24.839862 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 04:51:24.961454 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 04:51:25.080787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:51:25.580360 run create_hlr_db(pid=28761): Launched 04:51:26.760197 run create_hlr_db(pid=28761): Terminated: ok {rc=0} 04:51:27.099185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28763): Launched 04:51:27.420916 run osmo-hlr_10.42.42.2(pid=28764): Launched 04:51:27.545121 run osmo-stp_10.42.42.5: Starting osmo-stp 04:51:28.103242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28766): Launched 04:51:28.424287 run osmo-stp_10.42.42.5(pid=28767): Launched 04:51:28.546605 run osmo-msc_10.42.42.6: Starting osmo-msc 04:51:29.129597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28769): Launched 04:51:29.449646 run osmo-msc_10.42.42.6(pid=28770): Launched 04:51:29.628510 run osmo-stp_10.42.42.5(pid=28767): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28767)] 04:51:29.763638 run osmo-stp_10.42.42.5(pid=28767): stdout: | (launched: 2022-12-10_04:51:28.365650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:51:29.901495 run osmo-stp_10.42.42.5(pid=28767): stderr: | 20221210045128556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045128556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045128556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045128556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045128557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045128557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045128557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:51:30.035927 run osmo-stp_10.42.42.5(pid=28767): stdout: | (launched: 2022-12-10_04:51:28.365650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:51:30.163157 run osmo-stp_10.42.42.5(pid=28767): stderr: | 20221210045128556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045128556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045128556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045128556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045128557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045128557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045128557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:51:30.315130 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28767): Process ended prematurely: osmo-stp_10.42.42.5(pid=28767) [trial-2369↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28767)] [trial-2369↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 04:51:30.323941 tst handover.py:18: Test FAILED (6.6 sec) 04:51:30.351367 run osmo-hlr_10.42.42.2(pid=28764): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28764)] 04:51:30.400936 run osmo-hlr_10.42.42.2(pid=28764): stdout: | (launched: 2022-12-10_04:51:27.361706) 04:51:30.452225 run osmo-hlr_10.42.42.2(pid=28764): stderr: | 20221210045127559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045127559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045127560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045127560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045127560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045127560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045127572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045127580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045127580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045127580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:51:30.523939 run osmo-msc_10.42.42.6(pid=28770): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28770)] 04:51:30.573576 run osmo-msc_10.42.42.6(pid=28770): stdout: | (launched: 2022-12-10_04:51:29.391262) 04:51:30.625142 run osmo-msc_10.42.42.6(pid=28770): stderr: | 20221210045129713 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045129713 DLGLOBAL DEBUG validating counter group 0x7fccf4bbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045129713 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045129713 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045129713 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045129713 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045129715 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045129715 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045129715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045129716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:51:30.676513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28763): Terminating (SIGTERM) 04:51:30.717901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28766): Terminating (SIGTERM) 04:51:30.759394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28769): Terminating (SIGTERM) 04:51:30.801152 --- ParallelTerminationStrategy: PID 28763 died... 04:51:30.820863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28763): Terminated: ok {rc=0} 04:51:30.868818 --- ParallelTerminationStrategy: PID 28766 died... 04:51:30.898523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28766): Terminated: ok {rc=0} 04:51:30.945181 --- ParallelTerminationStrategy: PID 28769 died... 04:51:30.964768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28769): Terminated: ok {rc=0} 04:51:31.062149 bus /sierra_3: Setting Powered False 04:51:32.173466 bus /sierra_3: Setting Powered False 04:51:33.290703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 04:51:34.532138 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:51:34.537101 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 04:51:34.577310 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 04:51:34.604134 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 04:51:34.655952 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 04:51:34.695489 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 04:51:34.722082 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 04:51:35.275735 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 04:51:35.280773 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:51:35.291651 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 04:51:35.329909 tst handover.py: using LAC 26104 04:51:35.450524 tst handover.py: using RAC 94 04:51:35.574120 tst handover.py: using CellId 26104 04:51:35.693391 tst handover.py: using BVCI 26105 04:51:35.804907 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 04:51:35.838347 tst handover.py: using LAC 26105 04:51:35.965281 tst handover.py: using RAC 95 04:51:36.089369 tst handover.py: using CellId 26105 04:51:36.214000 tst handover.py: using BVCI 26106 04:51:36.332805 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:51:36.344373 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:51:36.355743 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:51:36.366924 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:51:36.378152 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:51:36.389234 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 04:51:36.504212 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 04:51:36.618921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:51:37.061649 run create_hlr_db(pid=28776): Launched 04:51:37.185472 bus /sierra_2: Setting Powered False 04:51:38.245620 run create_hlr_db(pid=28776): Terminated: ok {rc=0} 04:51:38.658585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28778): Launched 04:51:38.982506 run osmo-hlr_10.42.42.2(pid=28779): Launched 04:51:39.104889 run osmo-stp_10.42.42.5: Starting osmo-stp 04:51:39.636172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28781): Launched 04:51:39.959396 run osmo-stp_10.42.42.5(pid=28782): Launched 04:51:40.082645 run osmo-msc_10.42.42.6: Starting osmo-msc 04:51:40.638046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28784): Launched 04:51:40.961300 run osmo-msc_10.42.42.6(pid=28785): Launched 04:51:41.142199 run osmo-stp_10.42.42.5(pid=28782): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28782)] 04:51:41.278719 run osmo-stp_10.42.42.5(pid=28782): stdout: | (launched: 2022-12-10_04:51:39.899676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:51:41.415772 run osmo-stp_10.42.42.5(pid=28782): stderr: | 20221210045140092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045140092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045140093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045140093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045140093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045140094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045140094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:51:41.551617 run osmo-stp_10.42.42.5(pid=28782): stdout: | (launched: 2022-12-10_04:51:39.899676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:51:41.680329 run osmo-stp_10.42.42.5(pid=28782): stderr: | 20221210045140092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045140092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045140093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045140093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045140093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045140094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045140094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:51:41.834650 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28782): Process ended prematurely: osmo-stp_10.42.42.5(pid=28782) [trial-2369↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28782)] [trial-2369↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 04:51:41.843661 tst handover.py:18: Test FAILED (6.6 sec) 04:51:41.870911 run osmo-hlr_10.42.42.2(pid=28779): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28779)] 04:51:41.921142 run osmo-hlr_10.42.42.2(pid=28779): stdout: | (launched: 2022-12-10_04:51:38.923158) 04:51:41.972317 run osmo-hlr_10.42.42.2(pid=28779): stderr: | 20221210045139121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045139121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045139121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045139121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045139121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045139121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045139132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045139142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045139143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045139143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:51:42.043925 run osmo-msc_10.42.42.6(pid=28785): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28785)] 04:51:42.093638 run osmo-msc_10.42.42.6(pid=28785): stdout: | (launched: 2022-12-10_04:51:40.902141) 04:51:42.144858 run osmo-msc_10.42.42.6(pid=28785): stderr: | 20221210045141224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045141225 DLGLOBAL DEBUG validating counter group 0x7f0131ec2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045141225 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045141225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045141225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045141225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045141227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045141227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045141227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045141227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:51:42.196399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28778): Terminating (SIGTERM) 04:51:42.237601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28781): Terminating (SIGTERM) 04:51:42.278974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28784): Terminating (SIGTERM) 04:51:42.320873 --- ParallelTerminationStrategy: PID 28778 died... 04:51:42.340747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28778): Terminated: ok {rc=0} 04:51:42.386506 --- ParallelTerminationStrategy: PID 28781 died... 04:51:42.405913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28781): Terminated: ok {rc=0} 04:51:42.451660 --- ParallelTerminationStrategy: PID 28784 died... 04:51:42.471073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28784): Terminated: ok {rc=0} 04:51:42.557353 bus /sierra_3: Setting Powered False 04:51:43.656717 bus /sierra_3: Setting Powered False 04:51:44.771032 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 04:51:46.040305 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:51:46.046785 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:51:46.103775 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:51:46.131845 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:51:46.184629 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:51:46.242875 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:51:46.272055 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:51:46.847278 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 04:51:46.853529 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:51:46.865906 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:51:46.904571 tst handover.py: using LAC 26106 04:51:47.026938 tst handover.py: using RAC 96 04:51:47.154665 tst handover.py: using CellId 26106 04:51:47.278886 tst handover.py: using BVCI 26107 04:51:47.396469 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:51:47.446609 tst handover.py: using LAC 26107 04:51:47.567924 tst handover.py: using RAC 97 04:51:47.689097 tst handover.py: using CellId 26107 04:51:47.816606 tst handover.py: using BVCI 26108 04:51:47.928762 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:51:47.939810 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:51:47.950705 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:51:47.962431 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:51:47.974267 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:51:47.985820 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:51:48.101622 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:51:48.219135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:51:48.690347 run create_hlr_db(pid=28790): Launched 04:51:48.820209 bus /sierra_2: Setting Powered False 04:51:49.884633 run create_hlr_db(pid=28790): Terminated: ok {rc=0} 04:51:50.303901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28792): Launched 04:51:50.625851 run osmo-hlr_10.42.42.2(pid=28793): Launched 04:51:50.749048 run osmo-stp_10.42.42.5: Starting osmo-stp 04:51:51.277094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28795): Launched 04:51:51.597438 run osmo-stp_10.42.42.5(pid=28796): Launched 04:51:51.720025 run osmo-msc_10.42.42.6: Starting osmo-msc 04:51:52.274881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28798): Launched 04:51:52.597419 run osmo-msc_10.42.42.6(pid=28799): Launched 04:51:52.776896 run osmo-stp_10.42.42.5(pid=28796): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28796)] 04:51:52.912703 run osmo-stp_10.42.42.5(pid=28796): stdout: | (launched: 2022-12-10_04:51:51.538721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:51:53.048822 run osmo-stp_10.42.42.5(pid=28796): stderr: | 20221210045151731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045151731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045151731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045151732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045151734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045151734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045151734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:51:53.183720 run osmo-stp_10.42.42.5(pid=28796): stdout: | (launched: 2022-12-10_04:51:51.538721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:51:53.311549 run osmo-stp_10.42.42.5(pid=28796): stderr: | 20221210045151731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045151731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045151731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045151732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045151734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045151734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045151734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:51:53.464160 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28796): Process ended prematurely: osmo-stp_10.42.42.5(pid=28796) [trial-2369↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28796)] [trial-2369↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 04:51:53.473029 tst handover.py:18: Test FAILED (6.6 sec) 04:51:53.500194 run osmo-hlr_10.42.42.2(pid=28793): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28793)] 04:51:53.549913 run osmo-hlr_10.42.42.2(pid=28793): stdout: | (launched: 2022-12-10_04:51:50.567111) 04:51:53.601322 run osmo-hlr_10.42.42.2(pid=28793): stderr: | 20221210045150766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045150766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045150766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045150766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045150766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045150766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045150779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045150787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045150787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045150787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:51:53.672806 run osmo-msc_10.42.42.6(pid=28799): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28799)] 04:51:53.722508 run osmo-msc_10.42.42.6(pid=28799): stdout: | (launched: 2022-12-10_04:51:52.538362) 04:51:53.773910 run osmo-msc_10.42.42.6(pid=28799): stderr: | 20221210045152864 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045152864 DLGLOBAL DEBUG validating counter group 0x7fabe0c65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045152864 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045152864 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045152864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045152865 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045152866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045152867 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045152867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045152867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:51:53.825713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28792): Terminating (SIGTERM) 04:51:53.866977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28795): Terminating (SIGTERM) 04:51:53.908561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28798): Terminating (SIGTERM) 04:51:53.950089 --- ParallelTerminationStrategy: PID 28792 died... 04:51:53.969692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28792): Terminated: ok {rc=0} 04:51:54.015340 --- ParallelTerminationStrategy: PID 28795 died... 04:51:54.034665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28795): Terminated: ok {rc=0} 04:51:54.080467 --- ParallelTerminationStrategy: PID 28798 died... 04:51:54.099980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28798): Terminated: ok {rc=0} 04:51:54.187586 bus /sierra_3: Setting Powered False 04:51:55.286480 bus /sierra_3: Setting Powered False 04:51:56.404334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:51:57.662062 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:51:57.668599 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:51:57.719735 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:51:57.747402 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:51:57.801310 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:51:57.853259 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:51:57.880694 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:51:58.432558 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:51:58.437977 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:51:58.449498 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:51:58.488173 tst handover.py: using LAC 26108 04:51:58.614445 tst handover.py: using RAC 98 04:51:58.743814 tst handover.py: using CellId 26108 04:51:58.870265 tst handover.py: using BVCI 26109 04:51:58.988615 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:51:59.034665 tst handover.py: using LAC 26109 04:51:59.162422 tst handover.py: using RAC 99 04:51:59.287894 tst handover.py: using CellId 26109 04:51:59.413805 tst handover.py: using BVCI 26110 04:51:59.531329 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:51:59.542971 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:51:59.554336 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:51:59.565792 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:51:59.577178 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:51:59.588487 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:51:59.707866 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:51:59.824181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:00.267764 run create_hlr_db(pid=28804): Launched 04:52:00.384268 bus /sierra_2: Setting Powered False 04:52:01.460627 run create_hlr_db(pid=28804): Terminated: ok {rc=0} 04:52:01.933716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28806): Launched 04:52:02.266448 run osmo-hlr_10.42.42.2(pid=28807): Launched 04:52:02.389889 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:02.918781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28809): Launched 04:52:03.242032 run osmo-stp_10.42.42.5(pid=28810): Launched 04:52:03.365542 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:03.924902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28812): Launched 04:52:04.247590 run osmo-msc_10.42.42.6(pid=28813): Launched 04:52:04.427153 run osmo-stp_10.42.42.5(pid=28810): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28810)] 04:52:04.562581 run osmo-stp_10.42.42.5(pid=28810): stdout: | (launched: 2022-12-10_04:52:03.182745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:04.698907 run osmo-stp_10.42.42.5(pid=28810): stderr: | 20221210045203376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045203376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045203376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045203377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045203377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045203377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045203378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:04.834283 run osmo-stp_10.42.42.5(pid=28810): stdout: | (launched: 2022-12-10_04:52:03.182745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:04.963414 run osmo-stp_10.42.42.5(pid=28810): stderr: | 20221210045203376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045203376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045203376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045203377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045203377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045203377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045203378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:05.117100 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28810): Process ended prematurely: osmo-stp_10.42.42.5(pid=28810) [trial-2369↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28810)] [trial-2369↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 04:52:05.126113 tst handover.py:18: Test FAILED (6.7 sec) 04:52:05.153348 run osmo-hlr_10.42.42.2(pid=28807): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28807)] 04:52:05.202846 run osmo-hlr_10.42.42.2(pid=28807): stdout: | (launched: 2022-12-10_04:52:02.207299) 04:52:05.253987 run osmo-hlr_10.42.42.2(pid=28807): stderr: | 20221210045202405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045202405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045202405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045202405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045202405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045202406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045202418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045202426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045202426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045202427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:05.325071 run osmo-msc_10.42.42.6(pid=28813): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28813)] 04:52:05.374630 run osmo-msc_10.42.42.6(pid=28813): stdout: | (launched: 2022-12-10_04:52:04.188495) 04:52:05.425690 run osmo-msc_10.42.42.6(pid=28813): stderr: | 20221210045204511 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045204511 DLGLOBAL DEBUG validating counter group 0x7f736bc02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045204511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045204511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045204511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045204511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045204513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045204514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045204514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045204514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:05.477180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28806): Terminating (SIGTERM) 04:52:05.518531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28809): Terminating (SIGTERM) 04:52:05.560117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28812): Terminating (SIGTERM) 04:52:05.601891 --- ParallelTerminationStrategy: PID 28806 died... 04:52:05.621805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28806): Terminated: ok {rc=0} 04:52:05.667775 --- ParallelTerminationStrategy: PID 28809 died... 04:52:05.687103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28809): Terminated: ok {rc=0} 04:52:05.732774 --- ParallelTerminationStrategy: PID 28812 died... 04:52:05.752137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28812): Terminated: ok {rc=0} 04:52:05.839761 bus /sierra_3: Setting Powered False 04:52:06.939009 bus /sierra_3: Setting Powered False 04:52:08.053801 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:52:09.309184 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:09.314297 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:52:09.369614 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:52:09.396311 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:52:09.449147 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:52:09.503485 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:52:09.530655 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:52:10.083624 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:52:10.088634 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:52:10.099734 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:52:10.138766 tst handover.py: using LAC 26110 04:52:10.256201 tst handover.py: using RAC 100 04:52:10.375653 tst handover.py: using CellId 26110 04:52:10.492807 tst handover.py: using BVCI 26111 04:52:10.602336 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:52:10.652692 tst handover.py: using LAC 26111 04:52:10.771592 tst handover.py: using RAC 101 04:52:10.897426 tst handover.py: using CellId 26111 04:52:11.022934 tst handover.py: using BVCI 26112 04:52:11.140386 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:52:11.152147 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:52:11.163610 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:52:11.175389 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:52:11.186975 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:52:11.198277 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:52:11.313199 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:52:11.427082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:11.870824 run create_hlr_db(pid=28818): Launched 04:52:11.987545 bus /sierra_2: Setting Powered False 04:52:13.047375 run create_hlr_db(pid=28818): Terminated: ok {rc=0} 04:52:13.443839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Launched 04:52:13.747831 run osmo-hlr_10.42.42.2(pid=28821): Launched 04:52:13.863953 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:14.374958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Launched 04:52:14.678473 run osmo-stp_10.42.42.5(pid=28824): Launched 04:52:14.794639 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:15.317226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Launched 04:52:15.620697 run osmo-msc_10.42.42.6(pid=28827): Launched 04:52:15.794263 run osmo-stp_10.42.42.5(pid=28824): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] 04:52:16.045057 run osmo-stp_10.42.42.5(pid=28824): stdout: | (launched: 2022-12-10_04:52:14.622573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:16.182402 run osmo-stp_10.42.42.5(pid=28824): stderr: | 20221210045214791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045214792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045214792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045214792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045214793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045214793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045214793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:16.317716 run osmo-stp_10.42.42.5(pid=28824): stdout: | (launched: 2022-12-10_04:52:14.622573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:16.446839 run osmo-stp_10.42.42.5(pid=28824): stderr: | 20221210045214791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045214792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045214792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045214792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045214793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045214793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045214793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:16.601760 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28824): Process ended prematurely: osmo-stp_10.42.42.5(pid=28824) [trial-2369↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] [trial-2369↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 04:52:16.611487 tst handover.py:18: Test FAILED (6.5 sec) 04:52:16.640586 run osmo-hlr_10.42.42.2(pid=28821): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28821)] 04:52:16.691478 run osmo-hlr_10.42.42.2(pid=28821): stdout: | (launched: 2022-12-10_04:52:13.691640) 04:52:16.743714 run osmo-hlr_10.42.42.2(pid=28821): stderr: | 20221210045213870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045213870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045213870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045213870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045213870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045213870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045213882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045213890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045213891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045213891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:16.817260 run osmo-msc_10.42.42.6(pid=28827): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28827)] 04:52:16.867786 run osmo-msc_10.42.42.6(pid=28827): stdout: | (launched: 2022-12-10_04:52:15.564417) 04:52:16.919909 run osmo-msc_10.42.42.6(pid=28827): stderr: | 20221210045215853 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045215853 DLGLOBAL DEBUG validating counter group 0x7f58356fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045215854 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045215854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045215854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045215854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045215856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045215856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045215856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045215856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:16.972576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Terminating (SIGTERM) 04:52:17.015686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Terminating (SIGTERM) 04:52:17.059785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Terminating (SIGTERM) 04:52:17.104470 --- ParallelTerminationStrategy: PID 28820 died... 04:52:17.124189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Terminated: ok {rc=0} 04:52:17.172509 --- ParallelTerminationStrategy: PID 28823 died... 04:52:17.192294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Terminated: ok {rc=0} 04:52:17.238475 --- ParallelTerminationStrategy: PID 28826 died... 04:52:17.258156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Terminated: ok {rc=0} 04:52:17.344160 bus /sierra_3: Setting Powered False 04:52:18.441782 bus /sierra_3: Setting Powered False 04:52:19.556397 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 04:52:20.810970 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:20.816007 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:52:20.857971 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:52:20.884785 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:52:20.939183 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:52:20.983414 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:52:21.011087 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:52:21.553717 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 04:52:21.559786 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:52:21.571359 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 04:52:21.609999 tst handover.py: using LAC 26112 04:52:21.727726 tst handover.py: using RAC 102 04:52:21.845104 tst handover.py: using CellId 26112 04:52:21.970317 tst handover.py: using BVCI 26113 04:52:22.086023 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 04:52:22.121552 tst handover.py: using LAC 26113 04:52:22.245279 tst handover.py: using RAC 103 04:52:22.369281 tst handover.py: using CellId 26113 04:52:22.493474 tst handover.py: using BVCI 26114 04:52:22.608553 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:52:22.620015 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:52:22.631368 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:52:22.643376 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:52:22.655381 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:52:22.667212 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 04:52:22.783222 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 04:52:22.897696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:23.333173 run create_hlr_db(pid=28832): Launched 04:52:23.446774 bus /sierra_2: Setting Powered False 04:52:24.506185 run create_hlr_db(pid=28832): Terminated: ok {rc=0} 04:52:24.894466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Launched 04:52:25.190272 run osmo-hlr_10.42.42.2(pid=28835): Launched 04:52:25.303033 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:25.786679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Launched 04:52:26.086986 run osmo-stp_10.42.42.5(pid=28838): Launched 04:52:26.200341 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:26.710973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Launched 04:52:27.006009 run osmo-msc_10.42.42.6(pid=28841): Launched 04:52:27.172180 run osmo-stp_10.42.42.5(pid=28838): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] 04:52:27.298414 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-10_04:52:26.032937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:27.424275 run osmo-stp_10.42.42.5(pid=28838): stderr: | 20221210045226200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045226200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045226201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045226201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045226202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045226202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045226202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:27.548077 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-10_04:52:26.032937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:27.666186 run osmo-stp_10.42.42.5(pid=28838): stderr: | 20221210045226200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045226200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045226201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045226201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045226202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045226202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045226202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:27.807570 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2369↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] [trial-2369↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 04:52:27.816042 tst handover.py:18: Test FAILED (6.2 sec) 04:52:27.842874 run osmo-hlr_10.42.42.2(pid=28835): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28835)] 04:52:27.890244 run osmo-hlr_10.42.42.2(pid=28835): stdout: | (launched: 2022-12-10_04:52:25.135907) 04:52:27.939236 run osmo-hlr_10.42.42.2(pid=28835): stderr: | 20221210045225311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045225311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045225311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045225311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045225311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045225311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045225326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045225336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045225336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045225336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:28.007314 run osmo-msc_10.42.42.6(pid=28841): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28841)] 04:52:28.054822 run osmo-msc_10.42.42.6(pid=28841): stdout: | (launched: 2022-12-10_04:52:26.951900) 04:52:28.103244 run osmo-msc_10.42.42.6(pid=28841): stderr: | 20221210045227220 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045227220 DLGLOBAL DEBUG validating counter group 0x7f60bc0c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045227220 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045227220 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045227221 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045227221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045227223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045227223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045227224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045227224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:28.152054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminating (SIGTERM) 04:52:28.191442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminating (SIGTERM) 04:52:28.230832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Terminating (SIGTERM) 04:52:28.270591 --- ParallelTerminationStrategy: PID 28834 died... 04:52:28.289445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminated: ok {rc=0} 04:52:28.334089 --- ParallelTerminationStrategy: PID 28837 died... 04:52:28.352416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminated: ok {rc=0} 04:52:28.396501 --- ParallelTerminationStrategy: PID 28840 died... 04:52:28.414933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Terminated: ok {rc=0} 04:52:28.498642 bus /sierra_3: Setting Powered False 04:52:29.596015 bus /sierra_3: Setting Powered False 04:52:30.710543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 04:52:31.992211 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:31.997332 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:52:32.062714 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:52:32.109940 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:52:32.171489 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:52:32.227329 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:52:32.254558 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:52:32.807016 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 04:52:32.813452 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:52:32.825378 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:52:32.864734 tst handover.py: using LAC 26114 04:52:32.989513 tst handover.py: using RAC 104 04:52:33.114351 tst handover.py: using CellId 26114 04:52:33.237935 tst handover.py: using BVCI 26115 04:52:33.352515 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:52:33.402579 tst handover.py: using LAC 26115 04:52:33.526510 tst handover.py: using RAC 105 04:52:33.649949 tst handover.py: using CellId 26115 04:52:33.775682 tst handover.py: using BVCI 26116 04:52:33.892246 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:52:33.903566 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:52:33.915068 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:52:33.926706 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:52:33.938441 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:52:33.950044 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:52:34.063345 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:52:34.179244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:34.617364 run create_hlr_db(pid=28846): Launched 04:52:34.730668 bus /sierra_2: Setting Powered False 04:52:35.789983 run create_hlr_db(pid=28846): Terminated: ok {rc=0} 04:52:36.180907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28848): Launched 04:52:36.478341 run osmo-hlr_10.42.42.2(pid=28849): Launched 04:52:36.591176 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:37.077035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28851): Launched 04:52:37.368434 run osmo-stp_10.42.42.5(pid=28852): Launched 04:52:37.479877 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:37.983369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28854): Launched 04:52:38.275415 run osmo-msc_10.42.42.6(pid=28855): Launched 04:52:38.438955 run osmo-stp_10.42.42.5(pid=28852): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28852)] 04:52:38.562919 run osmo-stp_10.42.42.5(pid=28852): stdout: | (launched: 2022-12-10_04:52:37.315152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:38.687085 run osmo-stp_10.42.42.5(pid=28852): stderr: | 20221210045237484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045237484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045237484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045237484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045237485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045237485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045237485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:38.808923 run osmo-stp_10.42.42.5(pid=28852): stdout: | (launched: 2022-12-10_04:52:37.315152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:38.925378 run osmo-stp_10.42.42.5(pid=28852): stderr: | 20221210045237484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045237484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045237484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045237484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045237485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045237485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045237485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:39.064363 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28852): Process ended prematurely: osmo-stp_10.42.42.5(pid=28852) [trial-2369↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28852)] [trial-2369↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 04:52:39.072750 tst handover.py:18: Test FAILED (6.3 sec) 04:52:39.098373 run osmo-hlr_10.42.42.2(pid=28849): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28849)] 04:52:39.145364 run osmo-hlr_10.42.42.2(pid=28849): stdout: | (launched: 2022-12-10_04:52:36.425646) 04:52:39.193446 run osmo-hlr_10.42.42.2(pid=28849): stderr: | 20221210045236597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045236597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045236597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045236597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045236597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045236597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045236609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045236619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045236619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045236620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:39.260786 run osmo-msc_10.42.42.6(pid=28855): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28855)] 04:52:39.307285 run osmo-msc_10.42.42.6(pid=28855): stdout: | (launched: 2022-12-10_04:52:38.221986) 04:52:39.355542 run osmo-msc_10.42.42.6(pid=28855): stderr: | 20221210045238490 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045238490 DLGLOBAL DEBUG validating counter group 0x7f220316bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045238490 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045238490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045238490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045238491 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045238492 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045238493 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045238493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045238493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:39.404734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28848): Terminating (SIGTERM) 04:52:39.443654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28851): Terminating (SIGTERM) 04:52:39.482702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28854): Terminating (SIGTERM) 04:52:39.522280 --- ParallelTerminationStrategy: PID 28848 died... 04:52:39.540761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28848): Terminated: ok {rc=0} 04:52:39.584572 --- ParallelTerminationStrategy: PID 28851 died... 04:52:39.602863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28851): Terminated: ok {rc=0} 04:52:39.646149 --- ParallelTerminationStrategy: PID 28854 died... 04:52:39.664384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28854): Terminated: ok {rc=0} 04:52:39.746878 bus /sierra_3: Setting Powered False 04:52:40.843903 bus /sierra_3: Setting Powered False 04:52:41.959035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 04:52:43.211661 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:43.216706 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:52:43.269110 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:52:43.295049 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:52:43.347120 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:52:43.399044 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:52:43.425141 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:52:43.973935 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 04:52:43.978915 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:52:43.989721 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:52:44.026894 tst handover.py: using LAC 26116 04:52:44.140790 tst handover.py: using RAC 106 04:52:44.258915 tst handover.py: using CellId 26116 04:52:44.373267 tst handover.py: using BVCI 26117 04:52:44.478866 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:52:44.525458 tst handover.py: using LAC 26117 04:52:44.647111 tst handover.py: using RAC 107 04:52:44.767337 tst handover.py: using CellId 26117 04:52:44.890934 tst handover.py: using BVCI 26118 04:52:45.006345 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:52:45.017847 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:52:45.029053 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:52:45.040199 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:52:45.051501 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:52:45.062762 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:52:45.175249 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:52:45.290718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:45.747762 run create_hlr_db(pid=28860): Launched 04:52:45.883556 bus /sierra_2: Setting Powered False 04:52:46.941955 run create_hlr_db(pid=28860): Terminated: ok {rc=0} 04:52:47.336556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28862): Launched 04:52:47.629326 run osmo-hlr_10.42.42.2(pid=28863): Launched 04:52:47.742278 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:48.236648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28865): Launched 04:52:48.526666 run osmo-stp_10.42.42.5(pid=28866): Launched 04:52:48.637794 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:49.141459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28868): Launched 04:52:49.432525 run osmo-msc_10.42.42.6(pid=28869): Launched 04:52:49.596529 run osmo-stp_10.42.42.5(pid=28866): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28866)] 04:52:49.720549 run osmo-stp_10.42.42.5(pid=28866): stdout: | (launched: 2022-12-10_04:52:48.473672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:49.844914 run osmo-stp_10.42.42.5(pid=28866): stderr: | 20221210045248642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045248643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045248643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045248643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045248644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045248644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045248644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:49.966945 run osmo-stp_10.42.42.5(pid=28866): stdout: | (launched: 2022-12-10_04:52:48.473672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:50.083074 run osmo-stp_10.42.42.5(pid=28866): stderr: | 20221210045248642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045248643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045248643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045248643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045248644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045248644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045248644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:50.222786 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28866): Process ended prematurely: osmo-stp_10.42.42.5(pid=28866) [trial-2369↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28866)] [trial-2369↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 04:52:50.230997 tst handover.py:18: Test FAILED (6.2 sec) 04:52:50.256916 run osmo-hlr_10.42.42.2(pid=28863): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28863)] 04:52:50.303547 run osmo-hlr_10.42.42.2(pid=28863): stdout: | (launched: 2022-12-10_04:52:47.575899) 04:52:50.352446 run osmo-hlr_10.42.42.2(pid=28863): stderr: | 20221210045247748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045247748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045247748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045247748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045247748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045247748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045247768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045247777 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045247777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045247777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:50.420031 run osmo-msc_10.42.42.6(pid=28869): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28869)] 04:52:50.466628 run osmo-msc_10.42.42.6(pid=28869): stdout: | (launched: 2022-12-10_04:52:49.379119) 04:52:50.514981 run osmo-msc_10.42.42.6(pid=28869): stderr: | 20221210045249648 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045249648 DLGLOBAL DEBUG validating counter group 0x7f046727ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045249648 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045249648 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045249648 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045249648 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045249652 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045249652 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045249652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045249653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:50.563690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28862): Terminating (SIGTERM) 04:52:50.602590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28865): Terminating (SIGTERM) 04:52:50.641582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28868): Terminating (SIGTERM) 04:52:50.680651 --- ParallelTerminationStrategy: PID 28862 died... 04:52:50.699370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28862): Terminated: ok {rc=0} 04:52:50.742882 --- ParallelTerminationStrategy: PID 28865 died... 04:52:50.761066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28865): Terminated: ok {rc=0} 04:52:50.804313 --- ParallelTerminationStrategy: PID 28868 died... 04:52:50.822490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28868): Terminated: ok {rc=0} 04:52:50.907265 bus /sierra_3: Setting Powered False 04:52:52.007101 bus /sierra_3: Setting Powered False 04:52:53.121934 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 04:52:54.383390 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:54.388745 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 04:52:54.426280 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 04:52:54.453934 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 04:52:54.507051 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 04:52:54.544502 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 04:52:54.571460 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 04:52:55.117483 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 04:52:55.122764 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:55.133774 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 04:52:55.173924 tst handover.py: using LAC 26118 04:52:55.289470 tst handover.py: using RAC 108 04:52:55.402503 tst handover.py: using CellId 26118 04:52:55.515152 tst handover.py: using BVCI 26119 04:52:55.620654 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 04:52:55.652847 tst handover.py: using LAC 26119 04:52:55.775088 tst handover.py: using RAC 109 04:52:55.896248 tst handover.py: using CellId 26119 04:52:56.017600 tst handover.py: using BVCI 26120 04:52:56.131000 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:56.142291 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:56.153528 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:56.165122 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:56.176693 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:56.188449 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 04:52:56.306632 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 04:52:56.420822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:56.850844 run create_hlr_db(pid=28875): Launched 04:52:56.961541 bus /sierra_2: Setting Powered False 04:52:58.020372 run create_hlr_db(pid=28875): Terminated: ok {rc=0} 04:52:58.402921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Launched 04:52:58.693628 run osmo-hlr_10.42.42.2(pid=28878): Launched 04:52:58.804341 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:59.285568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Launched 04:52:59.575239 run osmo-stp_10.42.42.5(pid=28881): Launched 04:52:59.686996 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:00.190417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Launched 04:53:00.482630 run osmo-msc_10.42.42.6(pid=28884): Launched 04:53:00.646180 run osmo-stp_10.42.42.5(pid=28881): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] 04:53:00.769810 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-10_04:52:59.522803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:00.905457 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221210045259690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045259690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045259691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045259691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045259693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045259693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045259693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:01.030587 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-10_04:52:59.522803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:01.158596 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221210045259690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045259690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045259691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045259691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045259693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045259693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045259693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:01.313623 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2369↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] [trial-2369↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 04:53:01.323228 tst handover.py:18: Test FAILED (6.2 sec) 04:53:01.352253 run osmo-hlr_10.42.42.2(pid=28878): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28878)] 04:53:01.403504 run osmo-hlr_10.42.42.2(pid=28878): stdout: | (launched: 2022-12-10_04:52:58.640672) 04:53:01.456417 run osmo-hlr_10.42.42.2(pid=28878): stderr: | 20221210045258815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045258815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045258815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045258815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045258815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045258815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045258832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045258841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045258841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045258841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:01.529100 run osmo-msc_10.42.42.6(pid=28884): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28884)] 04:53:01.579951 run osmo-msc_10.42.42.6(pid=28884): stdout: | (launched: 2022-12-10_04:53:00.429936) 04:53:01.633710 run osmo-msc_10.42.42.6(pid=28884): stderr: | 20221210045300700 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045300701 DLGLOBAL DEBUG validating counter group 0x7f7f559acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045300701 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045300701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045300701 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045300701 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045300703 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045300703 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045300704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045300704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:01.686137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminating (SIGTERM) 04:53:01.728496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminating (SIGTERM) 04:53:01.771266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminating (SIGTERM) 04:53:01.817508 --- ParallelTerminationStrategy: PID 28877 died... 04:53:01.837489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminated: ok {rc=0} 04:53:01.887066 --- ParallelTerminationStrategy: PID 28880 died... 04:53:01.906851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminated: ok {rc=0} 04:53:01.953424 --- ParallelTerminationStrategy: PID 28883 died... 04:53:01.972870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminated: ok {rc=0} 04:53:02.061415 bus /sierra_3: Setting Powered False 04:53:03.158164 bus /sierra_3: Setting Powered False 04:53:04.270523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 04:53:05.502813 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:05.507825 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:53:05.557191 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:53:05.584339 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:53:05.639080 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:53:05.690403 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:53:05.717440 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:53:06.260793 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 04:53:06.265812 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:53:06.276487 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:53:06.310121 tst handover.py: using LAC 26120 04:53:06.427549 tst handover.py: using RAC 110 04:53:06.541547 tst handover.py: using CellId 26120 04:53:06.666927 tst handover.py: using BVCI 26121 04:53:06.782085 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:53:06.832297 tst handover.py: using LAC 26121 04:53:06.957043 tst handover.py: using RAC 111 04:53:07.081346 tst handover.py: using CellId 26121 04:53:07.204295 tst handover.py: using BVCI 26122 04:53:07.318131 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:53:07.329298 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:53:07.340095 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:53:07.351584 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:53:07.363069 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:53:07.374589 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:53:07.490106 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:53:07.602952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:08.029036 run create_hlr_db(pid=28889): Launched 04:53:08.140878 bus /sierra_2: Setting Powered False 04:53:09.199378 run create_hlr_db(pid=28889): Terminated: ok {rc=0} 04:53:09.600385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28891): Launched 04:53:09.911630 run osmo-hlr_10.42.42.2(pid=28892): Launched 04:53:10.031434 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:10.544797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28894): Launched 04:53:10.855162 run osmo-stp_10.42.42.5(pid=28895): Launched 04:53:10.973326 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:11.509665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28897): Launched 04:53:11.821984 run osmo-msc_10.42.42.6(pid=28898): Launched 04:53:11.996294 run osmo-stp_10.42.42.5(pid=28895): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28895)] 04:53:12.127411 run osmo-stp_10.42.42.5(pid=28895): stdout: | (launched: 2022-12-10_04:53:10.798768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:12.259305 run osmo-stp_10.42.42.5(pid=28895): stderr: | 20221210045310989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045310989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045310989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045310990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045310990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045310990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045310990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:12.391085 run osmo-stp_10.42.42.5(pid=28895): stdout: | (launched: 2022-12-10_04:53:10.798768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:12.515415 run osmo-stp_10.42.42.5(pid=28895): stderr: | 20221210045310989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045310989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045310989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045310990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045310990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045310990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045310990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:12.664051 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=28895): Process ended prematurely: osmo-stp_10.42.42.5(pid=28895) [trial-2369↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28895)] [trial-2369↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 04:53:12.672909 tst handover.py:18: Test FAILED (6.4 sec) 04:53:12.699723 run osmo-hlr_10.42.42.2(pid=28892): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28892)] 04:53:12.748636 run osmo-hlr_10.42.42.2(pid=28892): stdout: | (launched: 2022-12-10_04:53:09.855783) 04:53:12.799668 run osmo-hlr_10.42.42.2(pid=28892): stderr: | 20221210045310054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045310054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045310054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045310054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045310054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045310054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045310070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045310081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045310081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045310081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:12.870543 run osmo-msc_10.42.42.6(pid=28898): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28898)] 04:53:12.919557 run osmo-msc_10.42.42.6(pid=28898): stdout: | (launched: 2022-12-10_04:53:11.764051) 04:53:12.970669 run osmo-msc_10.42.42.6(pid=28898): stderr: | 20221210045312085 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045312085 DLGLOBAL DEBUG validating counter group 0x7f5b06f38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045312085 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045312085 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045312085 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045312085 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045312087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045312088 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045312088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045312088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:13.021970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28891): Terminating (SIGTERM) 04:53:13.062908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28894): Terminating (SIGTERM) 04:53:13.103577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28897): Terminating (SIGTERM) 04:53:13.144408 --- ParallelTerminationStrategy: PID 28891 died... 04:53:13.163922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28891): Terminated: ok {rc=0} 04:53:13.209142 --- ParallelTerminationStrategy: PID 28894 died... 04:53:13.228065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28894): Terminated: ok {rc=0} 04:53:13.272805 --- ParallelTerminationStrategy: PID 28897 died... 04:53:13.291999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28897): Terminated: ok {rc=0} 04:53:13.377844 bus /sierra_3: Setting Powered False 04:53:14.474296 bus /sierra_3: Setting Powered False 04:53:15.588023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:53:16.908754 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:16.918481 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:53:16.994771 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:53:17.033828 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:53:17.095817 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:53:17.163598 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:53:17.202711 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:53:17.797835 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:53:17.804596 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:53:17.819959 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:53:17.871176 tst handover.py: using LAC 26122 04:53:18.028188 tst handover.py: using RAC 112 04:53:18.167758 tst handover.py: using CellId 26122 04:53:18.314502 tst handover.py: using BVCI 26123 04:53:18.451835 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:53:18.510787 tst handover.py: using LAC 26123 04:53:18.666114 tst handover.py: using RAC 113 04:53:18.813200 tst handover.py: using CellId 26123 04:53:18.967325 tst handover.py: using BVCI 26124 04:53:19.097710 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:53:19.109671 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:53:19.122602 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:53:19.135465 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:53:19.147506 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:53:19.159913 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:53:19.276557 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:53:19.392885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:19.842551 run create_hlr_db(pid=29173): Launched 04:53:19.993879 bus /sierra_2: Setting Powered False 04:53:21.054550 run create_hlr_db(pid=29173): Terminated: ok {rc=0} 04:53:21.472055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29177): Launched 04:53:21.817619 run osmo-hlr_10.42.42.2(pid=29178): Launched 04:53:22.052682 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:22.669647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29180): Launched 04:53:22.990065 run osmo-stp_10.42.42.5(pid=29181): Launched 04:53:23.232769 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:23.873499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29183): Launched 04:53:24.218752 run osmo-msc_10.42.42.6(pid=29184): Launched 04:53:24.584280 run osmo-stp_10.42.42.5(pid=29181): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29181)] 04:53:24.864162 run osmo-stp_10.42.42.5(pid=29181): stdout: | (launched: 2022-12-10_04:53:22.931435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:25.043323 run osmo-stp_10.42.42.5(pid=29181): stderr: | 20221210045323219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045323219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045323219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045323220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045323220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045323220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045323220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:25.182507 run osmo-stp_10.42.42.5(pid=29181): stdout: | (launched: 2022-12-10_04:53:22.931435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:25.316234 run osmo-stp_10.42.42.5(pid=29181): stderr: | 20221210045323219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045323219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045323219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045323220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045323220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045323220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045323220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:25.475494 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29181): Process ended prematurely: osmo-stp_10.42.42.5(pid=29181) [trial-2369↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29181)] [trial-2369↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 04:53:25.485971 tst handover.py:18: Test FAILED (7.7 sec) 04:53:25.514851 run osmo-hlr_10.42.42.2(pid=29178): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29178)] 04:53:25.566814 run osmo-hlr_10.42.42.2(pid=29178): stdout: | (launched: 2022-12-10_04:53:21.746620) 04:53:25.620535 run osmo-hlr_10.42.42.2(pid=29178): stderr: | 20221210045322046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045322046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045322046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045322046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045322046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045322047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045322066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045322074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045322074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045322075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:25.695866 run osmo-msc_10.42.42.6(pid=29184): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29184)] 04:53:25.747913 run osmo-msc_10.42.42.6(pid=29184): stdout: | (launched: 2022-12-10_04:53:24.156319) 04:53:25.801588 run osmo-msc_10.42.42.6(pid=29184): stderr: | 20221210045324651 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045324651 DLGLOBAL DEBUG validating counter group 0x7f51af5ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045324651 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045324651 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045324652 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045324652 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045324662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045324665 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045324665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045324665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:25.855688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29177): Terminating (SIGTERM) 04:53:25.899941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29180): Terminating (SIGTERM) 04:53:25.945721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29183): Terminating (SIGTERM) 04:53:25.991772 --- ParallelTerminationStrategy: PID 29177 died... 04:53:26.012710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29177): Terminated: ok {rc=0} 04:53:26.062256 --- ParallelTerminationStrategy: PID 29180 died... 04:53:26.082796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29180): Terminated: ok {rc=0} 04:53:26.130713 --- ParallelTerminationStrategy: PID 29183 died... 04:53:26.151321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29183): Terminated: ok {rc=0} 04:53:26.241724 bus /sierra_3: Setting Powered False 04:53:27.344275 bus /sierra_3: Setting Powered False 04:53:28.464284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:53:29.727674 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:29.734141 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:53:29.787917 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:53:29.816513 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:53:29.869795 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:53:29.922498 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:53:29.951336 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:53:30.505623 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:53:30.512642 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:30.525433 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:53:30.561464 tst handover.py: using LAC 26124 04:53:30.694995 tst handover.py: using RAC 114 04:53:30.825383 tst handover.py: using CellId 26124 04:53:30.963779 tst handover.py: using BVCI 26125 04:53:31.107076 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:53:31.162380 tst handover.py: using LAC 26125 04:53:31.311417 tst handover.py: using RAC 115 04:53:31.451534 tst handover.py: using CellId 26125 04:53:31.631584 tst handover.py: using BVCI 26126 04:53:31.788021 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:31.800156 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:31.812045 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:31.823886 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:31.837299 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:31.848923 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:53:32.000801 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:53:32.140518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:32.698540 run create_hlr_db(pid=29189): Launched 04:53:32.876006 bus /sierra_2: Setting Powered False 04:53:33.941848 run create_hlr_db(pid=29189): Terminated: ok {rc=0} 04:53:34.380026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29191): Launched 04:53:34.726550 run osmo-hlr_10.42.42.2(pid=29192): Launched 04:53:34.972652 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:35.630681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29194): Launched 04:53:35.977525 run osmo-stp_10.42.42.5(pid=29195): Launched 04:53:36.228685 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:36.884400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29197): Launched 04:53:37.231119 run osmo-msc_10.42.42.6(pid=29198): Launched 04:53:37.595655 run osmo-stp_10.42.42.5(pid=29195): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29195)] 04:53:37.890078 run osmo-stp_10.42.42.5(pid=29195): stdout: | (launched: 2022-12-10_04:53:35.915407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:38.064509 run osmo-stp_10.42.42.5(pid=29195): stderr: | 20221210045336220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045336220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045336220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045336221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045336221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045336221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045336221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:38.204076 run osmo-stp_10.42.42.5(pid=29195): stdout: | (launched: 2022-12-10_04:53:35.915407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:38.337750 run osmo-stp_10.42.42.5(pid=29195): stderr: | 20221210045336220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045336220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045336220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045336221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045336221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045336221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045336221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:38.498321 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29195): Process ended prematurely: osmo-stp_10.42.42.5(pid=29195) [trial-2369↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29195)] [trial-2369↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 04:53:38.508230 tst handover.py:18: Test FAILED (8.0 sec) 04:53:38.537315 run osmo-hlr_10.42.42.2(pid=29192): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29192)] 04:53:38.589814 run osmo-hlr_10.42.42.2(pid=29192): stdout: | (launched: 2022-12-10_04:53:34.665659) 04:53:38.645139 run osmo-hlr_10.42.42.2(pid=29192): stderr: | 20221210045334981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045334981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045334982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045334982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045334982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045334982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045334997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045335013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045335013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045335013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:38.720154 run osmo-msc_10.42.42.6(pid=29198): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29198)] 04:53:38.771926 run osmo-msc_10.42.42.6(pid=29198): stdout: | (launched: 2022-12-10_04:53:37.168781) 04:53:38.826115 run osmo-msc_10.42.42.6(pid=29198): stderr: | 20221210045337685 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045337686 DLGLOBAL DEBUG validating counter group 0x7f5cb74b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045337686 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045337686 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045337686 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045337686 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045337688 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045337688 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045337689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045337689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:38.881339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29191): Terminating (SIGTERM) 04:53:38.924506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29194): Terminating (SIGTERM) 04:53:38.970832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29197): Terminating (SIGTERM) 04:53:39.015939 --- ParallelTerminationStrategy: PID 29191 died... 04:53:39.037549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29191): Terminated: ok {rc=0} 04:53:39.085900 --- ParallelTerminationStrategy: PID 29194 died... 04:53:39.106467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29194): Terminated: ok {rc=0} 04:53:39.153758 --- ParallelTerminationStrategy: PID 29197 died... 04:53:39.174590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29197): Terminated: ok {rc=0} 04:53:39.265721 bus /sierra_3: Setting Powered False 04:53:40.365562 bus /sierra_3: Setting Powered False 04:53:41.479953 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 04:53:42.742854 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:42.748145 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:53:42.787155 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:53:42.814511 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:53:42.867648 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:53:42.906612 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:53:42.933965 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:53:43.486288 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 04:53:43.491565 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:43.503048 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 04:53:43.537660 tst handover.py: using LAC 26126 04:53:43.663972 tst handover.py: using RAC 116 04:53:43.791766 tst handover.py: using CellId 26126 04:53:43.918000 tst handover.py: using BVCI 26127 04:53:44.036848 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 04:53:44.073298 tst handover.py: using LAC 26127 04:53:44.199377 tst handover.py: using RAC 117 04:53:44.325539 tst handover.py: using CellId 26127 04:53:44.445614 tst handover.py: using BVCI 26128 04:53:44.558472 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:44.569381 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:44.580251 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:44.591818 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:44.602937 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:44.614078 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 04:53:44.727981 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 04:53:44.842697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:45.286166 run create_hlr_db(pid=29204): Launched 04:53:45.401126 bus /sierra_2: Setting Powered False 04:53:46.463990 run create_hlr_db(pid=29204): Terminated: ok {rc=0} 04:53:46.871090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Launched 04:53:47.193216 run osmo-hlr_10.42.42.2(pid=29207): Launched 04:53:47.310237 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:47.809270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Launched 04:53:48.111996 run osmo-stp_10.42.42.5(pid=29210): Launched 04:53:48.228365 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:48.750449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29212): Launched 04:53:49.053355 run osmo-msc_10.42.42.6(pid=29213): Launched 04:53:49.223265 run osmo-stp_10.42.42.5(pid=29210): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] 04:53:49.351751 run osmo-stp_10.42.42.5(pid=29210): stdout: | (launched: 2022-12-10_04:53:48.056561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:49.479916 run osmo-stp_10.42.42.5(pid=29210): stderr: | 20221210045348227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045348227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045348228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045348228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045348228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045348229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045348229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:49.606037 run osmo-stp_10.42.42.5(pid=29210): stdout: | (launched: 2022-12-10_04:53:48.056561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:49.726755 run osmo-stp_10.42.42.5(pid=29210): stderr: | 20221210045348227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045348227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045348228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045348228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045348228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045348229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045348229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:49.871139 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29210): Process ended prematurely: osmo-stp_10.42.42.5(pid=29210) [trial-2369↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] [trial-2369↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 04:53:49.879676 tst handover.py:18: Test FAILED (6.4 sec) 04:53:49.906404 run osmo-hlr_10.42.42.2(pid=29207): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29207)] 04:53:49.954172 run osmo-hlr_10.42.42.2(pid=29207): stdout: | (launched: 2022-12-10_04:53:47.136854) 04:53:50.003499 run osmo-hlr_10.42.42.2(pid=29207): stderr: | 20221210045347312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045347312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045347312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045347312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045347312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045347313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045347324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045347332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045347332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045347333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:50.072370 run osmo-msc_10.42.42.6(pid=29213): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29213)] 04:53:50.119686 run osmo-msc_10.42.42.6(pid=29213): stdout: | (launched: 2022-12-10_04:53:48.997989) 04:53:50.169061 run osmo-msc_10.42.42.6(pid=29213): stderr: | 20221210045349266 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045349266 DLGLOBAL DEBUG validating counter group 0x7f4927183c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045349267 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045349267 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045349267 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045349267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045349269 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045349269 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045349269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045349269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:50.218332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Terminating (SIGTERM) 04:53:50.258024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Terminating (SIGTERM) 04:53:50.297888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29212): Terminating (SIGTERM) 04:53:50.337705 --- ParallelTerminationStrategy: PID 29206 died... 04:53:50.356602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Terminated: ok {rc=0} 04:53:50.401149 --- ParallelTerminationStrategy: PID 29209 died... 04:53:50.419667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Terminated: ok {rc=0} 04:53:50.463759 --- ParallelTerminationStrategy: PID 29212 died... 04:53:50.482242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29212): Terminated: ok {rc=0} 04:53:50.567268 bus /sierra_3: Setting Powered False 04:53:51.665866 bus /sierra_3: Setting Powered False 04:53:52.781891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 04:53:54.022525 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:54.028857 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:53:54.080456 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:53:54.107371 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:53:54.156742 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:53:54.207278 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:53:54.234287 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:53:54.789436 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 04:53:54.794950 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:54.805983 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:53:54.840462 tst handover.py: using LAC 26128 04:53:54.958276 tst handover.py: using RAC 118 04:53:55.078173 tst handover.py: using CellId 26128 04:53:55.197302 tst handover.py: using BVCI 26129 04:53:55.316638 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:53:55.368541 tst handover.py: using LAC 26129 04:53:55.493910 tst handover.py: using RAC 119 04:53:55.617803 tst handover.py: using CellId 26129 04:53:55.741773 tst handover.py: using BVCI 26130 04:53:55.858131 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:55.869402 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:55.880429 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:55.891604 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:55.902819 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:55.913897 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:53:56.028688 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:53:56.146816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:56.617534 run create_hlr_db(pid=29218): Launched 04:53:56.747842 bus /sierra_2: Setting Powered False 04:53:57.811280 run create_hlr_db(pid=29218): Terminated: ok {rc=0} 04:53:58.217953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29220): Launched 04:53:58.521364 run osmo-hlr_10.42.42.2(pid=29221): Launched 04:53:58.638448 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:59.146813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29223): Launched 04:53:59.448531 run osmo-stp_10.42.42.5(pid=29224): Launched 04:53:59.564546 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:00.086474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29226): Launched 04:54:00.389259 run osmo-msc_10.42.42.6(pid=29227): Launched 04:54:00.560035 run osmo-stp_10.42.42.5(pid=29224): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29224)] 04:54:00.688781 run osmo-stp_10.42.42.5(pid=29224): stdout: | (launched: 2022-12-10_04:53:59.392906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:00.817894 run osmo-stp_10.42.42.5(pid=29224): stderr: | 20221210045359562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045359562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045359563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045359563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045359563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045359564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045359564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:00.953744 run osmo-stp_10.42.42.5(pid=29224): stdout: | (launched: 2022-12-10_04:53:59.392906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:01.078846 run osmo-stp_10.42.42.5(pid=29224): stderr: | 20221210045359562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045359562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045359563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045359563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045359563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045359564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045359564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:01.226448 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29224): Process ended prematurely: osmo-stp_10.42.42.5(pid=29224) [trial-2369↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29224)] [trial-2369↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 04:54:01.235879 tst handover.py:18: Test FAILED (6.4 sec) 04:54:01.265142 run osmo-hlr_10.42.42.2(pid=29221): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29221)] 04:54:01.315118 run osmo-hlr_10.42.42.2(pid=29221): stdout: | (launched: 2022-12-10_04:53:58.465776) 04:54:01.366799 run osmo-hlr_10.42.42.2(pid=29221): stderr: | 20221210045358642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045358642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045358642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045358642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045358642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045358643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045358655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045358663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045358664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045358664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:01.438451 run osmo-msc_10.42.42.6(pid=29227): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29227)] 04:54:01.488247 run osmo-msc_10.42.42.6(pid=29227): stdout: | (launched: 2022-12-10_04:54:00.334114) 04:54:01.539965 run osmo-msc_10.42.42.6(pid=29227): stderr: | 20221210045400603 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045400603 DLGLOBAL DEBUG validating counter group 0x7f749f803c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045400603 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045400603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045400604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045400604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045400606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045400606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045400606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045400606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:01.592154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29220): Terminating (SIGTERM) 04:54:01.634326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29223): Terminating (SIGTERM) 04:54:01.676195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29226): Terminating (SIGTERM) 04:54:01.718359 --- ParallelTerminationStrategy: PID 29220 died... 04:54:01.737909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29220): Terminated: ok {rc=0} 04:54:01.785138 --- ParallelTerminationStrategy: PID 29223 died... 04:54:01.804524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29223): Terminated: ok {rc=0} 04:54:01.851789 --- ParallelTerminationStrategy: PID 29226 died... 04:54:01.871177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29226): Terminated: ok {rc=0} 04:54:01.958353 bus /sierra_3: Setting Powered False 04:54:03.054774 bus /sierra_3: Setting Powered False 04:54:04.169914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 04:54:05.423255 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:05.428368 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:54:05.478608 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:54:05.505137 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:54:05.557507 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:54:05.608494 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:54:05.635359 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:54:06.182712 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 04:54:06.188215 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:54:06.199135 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:54:06.233129 tst handover.py: using LAC 26130 04:54:06.350753 tst handover.py: using RAC 120 04:54:06.469088 tst handover.py: using CellId 26130 04:54:06.596618 tst handover.py: using BVCI 26131 04:54:06.713191 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:54:06.763561 tst handover.py: using LAC 26131 04:54:06.890633 tst handover.py: using RAC 121 04:54:07.018508 tst handover.py: using CellId 26131 04:54:07.144772 tst handover.py: using BVCI 26132 04:54:07.261602 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:54:07.272819 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:54:07.283888 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:54:07.295027 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:54:07.306239 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:54:07.317338 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:54:07.430873 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:54:07.545437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:08.017045 run create_hlr_db(pid=29232): Launched 04:54:08.147606 bus /sierra_2: Setting Powered False 04:54:09.211308 run create_hlr_db(pid=29232): Terminated: ok {rc=0} 04:54:09.617744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29234): Launched 04:54:09.920819 run osmo-hlr_10.42.42.2(pid=29235): Launched 04:54:10.037281 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:10.533215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29237): Launched 04:54:10.836625 run osmo-stp_10.42.42.5(pid=29238): Launched 04:54:10.952807 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:11.476553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29240): Launched 04:54:11.780433 run osmo-msc_10.42.42.6(pid=29241): Launched 04:54:11.951024 run osmo-stp_10.42.42.5(pid=29238): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29238)] 04:54:12.080110 run osmo-stp_10.42.42.5(pid=29238): stdout: | (launched: 2022-12-10_04:54:10.781077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:12.209418 run osmo-stp_10.42.42.5(pid=29238): stderr: | 20221210045410952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045410952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045410952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045410953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045410953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045410953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045410953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:12.336019 run osmo-stp_10.42.42.5(pid=29238): stdout: | (launched: 2022-12-10_04:54:10.781077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:12.457319 run osmo-stp_10.42.42.5(pid=29238): stderr: | 20221210045410952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045410952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045410952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045410953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045410953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045410953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045410953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:12.602046 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29238): Process ended prematurely: osmo-stp_10.42.42.5(pid=29238) [trial-2369↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29238)] [trial-2369↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 04:54:12.610592 tst handover.py:18: Test FAILED (6.4 sec) 04:54:12.637490 run osmo-hlr_10.42.42.2(pid=29235): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29235)] 04:54:12.685632 run osmo-hlr_10.42.42.2(pid=29235): stdout: | (launched: 2022-12-10_04:54:09.865602) 04:54:12.734936 run osmo-hlr_10.42.42.2(pid=29235): stderr: | 20221210045410042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045410042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045410042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045410043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045410043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045410043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045410067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045410077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045410077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045410077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:12.803529 run osmo-msc_10.42.42.6(pid=29241): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29241)] 04:54:12.851050 run osmo-msc_10.42.42.6(pid=29241): stdout: | (launched: 2022-12-10_04:54:11.725129) 04:54:12.900501 run osmo-msc_10.42.42.6(pid=29241): stderr: | 20221210045411998 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045411998 DLGLOBAL DEBUG validating counter group 0x7f717c55ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045411999 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045411999 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045411999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045411999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045412001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045412001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045412001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045412001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:12.950300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29234): Terminating (SIGTERM) 04:54:12.990659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29237): Terminating (SIGTERM) 04:54:13.030577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29240): Terminating (SIGTERM) 04:54:13.070929 --- ParallelTerminationStrategy: PID 29234 died... 04:54:13.089850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29234): Terminated: ok {rc=0} 04:54:13.134240 --- ParallelTerminationStrategy: PID 29237 died... 04:54:13.152605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29237): Terminated: ok {rc=0} 04:54:13.196563 --- ParallelTerminationStrategy: PID 29240 died... 04:54:13.215250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29240): Terminated: ok {rc=0} 04:54:13.300401 bus /sierra_3: Setting Powered False 04:54:14.396802 bus /sierra_3: Setting Powered False 04:54:15.510768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 04:54:16.829470 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:16.838406 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:54:16.904102 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:54:16.938139 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:54:17.000587 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:54:17.062647 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:54:17.098706 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:54:17.627135 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 04:54:17.633361 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:17.644298 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:54:17.682694 tst handover.py: using LAC 26132 04:54:17.802377 tst handover.py: using RAC 122 04:54:17.921305 tst handover.py: using CellId 26132 04:54:18.042219 tst handover.py: using BVCI 26133 04:54:18.152392 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:54:18.206791 tst handover.py: using LAC 26133 04:54:18.327131 tst handover.py: using RAC 123 04:54:18.446126 tst handover.py: using CellId 26133 04:54:18.563359 tst handover.py: using BVCI 26134 04:54:18.673323 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:18.684236 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:18.695144 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:18.706682 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:18.718362 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:18.729876 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:54:18.843730 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:54:18.961822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:19.433378 run create_hlr_db(pid=29246): Launched 04:54:19.564010 bus /sierra_2: Setting Powered False 04:54:20.627961 run create_hlr_db(pid=29246): Terminated: ok {rc=0} 04:54:21.034008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29248): Launched 04:54:21.336779 run osmo-hlr_10.42.42.2(pid=29249): Launched 04:54:21.453067 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:21.960400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29251): Launched 04:54:22.262548 run osmo-stp_10.42.42.5(pid=29252): Launched 04:54:22.378267 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:22.904368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29254): Launched 04:54:23.209143 run osmo-msc_10.42.42.6(pid=29255): Launched 04:54:23.395121 run osmo-stp_10.42.42.5(pid=29252): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29252)] 04:54:23.533124 run osmo-stp_10.42.42.5(pid=29252): stdout: | (launched: 2022-12-10_04:54:22.207333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:23.672814 run osmo-stp_10.42.42.5(pid=29252): stderr: | 20221210045422376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045422376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045422377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045422377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045422377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045422378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045422378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:23.807287 run osmo-stp_10.42.42.5(pid=29252): stdout: | (launched: 2022-12-10_04:54:22.207333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:23.935824 run osmo-stp_10.42.42.5(pid=29252): stderr: | 20221210045422376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045422376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045422377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045422377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045422377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045422378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045422378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:24.090028 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29252): Process ended prematurely: osmo-stp_10.42.42.5(pid=29252) [trial-2369↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29252)] [trial-2369↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 04:54:24.099129 tst handover.py:18: Test FAILED (6.5 sec) 04:54:24.126526 run osmo-hlr_10.42.42.2(pid=29249): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29249)] 04:54:24.176491 run osmo-hlr_10.42.42.2(pid=29249): stdout: | (launched: 2022-12-10_04:54:21.281588) 04:54:24.228021 run osmo-hlr_10.42.42.2(pid=29249): stderr: | 20221210045421456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045421456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045421456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045421456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045421456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045421456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045421472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045421482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045421482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045421482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:24.299931 run osmo-msc_10.42.42.6(pid=29255): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29255)] 04:54:24.349796 run osmo-msc_10.42.42.6(pid=29255): stdout: | (launched: 2022-12-10_04:54:23.153296) 04:54:24.401130 run osmo-msc_10.42.42.6(pid=29255): stderr: | 20221210045423469 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045423469 DLGLOBAL DEBUG validating counter group 0x7f983861bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045423470 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045423470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045423470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045423470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045423472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045423472 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045423472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045423472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:24.454422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29248): Terminating (SIGTERM) 04:54:24.496119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29251): Terminating (SIGTERM) 04:54:24.536328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29254): Terminating (SIGTERM) 04:54:24.576893 --- ParallelTerminationStrategy: PID 29248 died... 04:54:24.596308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29248): Terminated: ok {rc=0} 04:54:24.640481 --- ParallelTerminationStrategy: PID 29251 died... 04:54:24.659019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29251): Terminated: ok {rc=0} 04:54:24.703171 --- ParallelTerminationStrategy: PID 29254 died... 04:54:24.721752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29254): Terminated: ok {rc=0} 04:54:24.807442 bus /sierra_3: Setting Powered False 04:54:25.906289 bus /sierra_3: Setting Powered False 04:54:27.023100 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:54:28.279256 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:28.284395 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:54:28.330319 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:54:28.357273 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:54:28.407462 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:54:28.452156 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:54:28.478538 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:54:29.033483 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:54:29.038840 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:29.050054 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:54:29.084145 tst handover.py: using LAC 26134 04:54:29.216930 tst handover.py: using RAC 124 04:54:29.343807 tst handover.py: using CellId 26134 04:54:29.469108 tst handover.py: using BVCI 26135 04:54:29.586163 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:54:29.630999 tst handover.py: using LAC 26135 04:54:29.758792 tst handover.py: using RAC 125 04:54:29.883756 tst handover.py: using CellId 26135 04:54:30.005067 tst handover.py: using BVCI 26136 04:54:30.115081 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:30.126154 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:30.136887 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:30.148660 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:30.160261 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:30.171795 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:54:30.288154 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:54:30.404171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:30.865186 run create_hlr_db(pid=29267): Launched 04:54:31.043002 bus /sierra_2: Setting Powered False 04:54:32.140499 run create_hlr_db(pid=29267): Terminated: ok {rc=0} 04:54:32.576377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29269): Launched 04:54:32.899952 run osmo-hlr_10.42.42.2(pid=29270): Launched 04:54:33.024576 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:33.553056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29272): Launched 04:54:33.875945 run osmo-stp_10.42.42.5(pid=29273): Launched 04:54:33.999549 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:34.557192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29275): Launched 04:54:34.879821 run osmo-msc_10.42.42.6(pid=29276): Launched 04:54:35.060554 run osmo-stp_10.42.42.5(pid=29273): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29273)] 04:54:35.196171 run osmo-stp_10.42.42.5(pid=29273): stdout: | (launched: 2022-12-10_04:54:33.817058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:35.332800 run osmo-stp_10.42.42.5(pid=29273): stderr: | 20221210045434010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045434010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045434011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045434011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045434012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045434012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045434012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:35.468030 run osmo-stp_10.42.42.5(pid=29273): stdout: | (launched: 2022-12-10_04:54:33.817058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:35.596680 run osmo-stp_10.42.42.5(pid=29273): stderr: | 20221210045434010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045434010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045434011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045434011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045434012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045434012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045434012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:35.750165 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29273): Process ended prematurely: osmo-stp_10.42.42.5(pid=29273) [trial-2369↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29273)] [trial-2369↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 04:54:35.759162 tst handover.py:18: Test FAILED (6.7 sec) 04:54:35.786568 run osmo-hlr_10.42.42.2(pid=29270): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29270)] 04:54:35.836200 run osmo-hlr_10.42.42.2(pid=29270): stdout: | (launched: 2022-12-10_04:54:32.841319) 04:54:35.887593 run osmo-hlr_10.42.42.2(pid=29270): stderr: | 20221210045433039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045433039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045433039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045433039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045433039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045433039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045433051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045433059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045433060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045433060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:35.959247 run osmo-msc_10.42.42.6(pid=29276): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29276)] 04:54:36.009166 run osmo-msc_10.42.42.6(pid=29276): stdout: | (launched: 2022-12-10_04:54:34.820771) 04:54:36.060652 run osmo-msc_10.42.42.6(pid=29276): stderr: | 20221210045435145 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045435145 DLGLOBAL DEBUG validating counter group 0x7f45d5960c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045435145 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045435145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045435145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045435146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045435147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045435148 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045435148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045435148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:36.111974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29269): Terminating (SIGTERM) 04:54:36.153555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29272): Terminating (SIGTERM) 04:54:36.195204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29275): Terminating (SIGTERM) 04:54:36.237112 --- ParallelTerminationStrategy: PID 29269 died... 04:54:36.256870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29269): Terminated: ok {rc=0} 04:54:36.302831 --- ParallelTerminationStrategy: PID 29272 died... 04:54:36.322394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29272): Terminated: ok {rc=0} 04:54:36.368051 --- ParallelTerminationStrategy: PID 29275 died... 04:54:36.387373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29275): Terminated: ok {rc=0} 04:54:36.473811 bus /sierra_3: Setting Powered False 04:54:37.573234 bus /sierra_3: Setting Powered False 04:54:38.688267 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:54:39.937794 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:39.944436 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:54:39.995522 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:54:40.023134 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:54:40.077135 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:54:40.128424 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:54:40.155672 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:54:40.710085 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:54:40.715289 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:40.726758 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:54:40.760821 tst handover.py: using LAC 26136 04:54:40.885650 tst handover.py: using RAC 126 04:54:41.013192 tst handover.py: using CellId 26136 04:54:41.138757 tst handover.py: using BVCI 26137 04:54:41.256669 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:54:41.305399 tst handover.py: using LAC 26137 04:54:41.432486 tst handover.py: using RAC 127 04:54:41.557753 tst handover.py: using CellId 26137 04:54:41.684889 tst handover.py: using BVCI 26138 04:54:41.801568 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:41.813289 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:41.824643 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:41.835901 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:41.847313 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:41.858763 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:54:41.972558 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:54:42.090000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:42.562812 run create_hlr_db(pid=29281): Launched 04:54:42.693459 bus /sierra_2: Setting Powered False 04:54:43.757530 run create_hlr_db(pid=29281): Terminated: ok {rc=0} 04:54:44.163609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29283): Launched 04:54:44.467664 run osmo-hlr_10.42.42.2(pid=29284): Launched 04:54:44.586694 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:45.117832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29286): Launched 04:54:45.439797 run osmo-stp_10.42.42.5(pid=29287): Launched 04:54:45.562444 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:46.139991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29289): Launched 04:54:46.468999 run osmo-msc_10.42.42.6(pid=29290): Launched 04:54:46.850574 run osmo-stp_10.42.42.5(pid=29287): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29287)] 04:54:47.085303 run osmo-stp_10.42.42.5(pid=29287): stdout: | (launched: 2022-12-10_04:54:45.381529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:47.223163 run osmo-stp_10.42.42.5(pid=29287): stderr: | 20221210045445572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045445572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045445572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045445573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045445575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045445575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045445576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:47.358709 run osmo-stp_10.42.42.5(pid=29287): stdout: | (launched: 2022-12-10_04:54:45.381529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:47.487053 run osmo-stp_10.42.42.5(pid=29287): stderr: | 20221210045445572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045445572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045445572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045445573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045445575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045445575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045445576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:47.640568 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29287): Process ended prematurely: osmo-stp_10.42.42.5(pid=29287) [trial-2369↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29287)] [trial-2369↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 04:54:47.649616 tst handover.py:18: Test FAILED (6.9 sec) 04:54:47.677155 run osmo-hlr_10.42.42.2(pid=29284): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29284)] 04:54:47.726956 run osmo-hlr_10.42.42.2(pid=29284): stdout: | (launched: 2022-12-10_04:54:44.412178) 04:54:47.778782 run osmo-hlr_10.42.42.2(pid=29284): stderr: | 20221210045444586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045444587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045444587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045444587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045444587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045444587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045444600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045444608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045444608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045444608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:47.851052 run osmo-msc_10.42.42.6(pid=29290): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29290)] 04:54:47.900754 run osmo-msc_10.42.42.6(pid=29290): stdout: | (launched: 2022-12-10_04:54:46.408638) 04:54:47.952103 run osmo-msc_10.42.42.6(pid=29290): stderr: | 20221210045446823 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045446823 DLGLOBAL DEBUG validating counter group 0x7f4867e50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045446823 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045446823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045446823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045446824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045446834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045446834 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045446834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045446834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:48.004375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29283): Terminating (SIGTERM) 04:54:48.046486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29286): Terminating (SIGTERM) 04:54:48.088159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29289): Terminating (SIGTERM) 04:54:48.129729 --- ParallelTerminationStrategy: PID 29283 died... 04:54:48.149581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29283): Terminated: ok {rc=0} 04:54:48.196004 --- ParallelTerminationStrategy: PID 29286 died... 04:54:48.215521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29286): Terminated: ok {rc=0} 04:54:48.261147 --- ParallelTerminationStrategy: PID 29289 died... 04:54:48.280711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29289): Terminated: ok {rc=0} 04:54:48.368375 bus /sierra_3: Setting Powered False 04:54:49.467312 bus /sierra_3: Setting Powered False 04:54:50.584309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 04:54:51.847543 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:51.853489 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:54:51.890680 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:54:51.917185 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:54:51.969936 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:54:52.006748 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:54:52.032757 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:54:52.582056 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 04:54:52.587071 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:52.597885 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 04:54:52.631740 tst handover.py: using LAC 26138 04:54:52.762277 tst handover.py: using RAC 128 04:54:52.890591 tst handover.py: using CellId 26138 04:54:53.018880 tst handover.py: using BVCI 26139 04:54:53.137510 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 04:54:53.174280 tst handover.py: using LAC 26139 04:54:53.298590 tst handover.py: using RAC 129 04:54:53.417684 tst handover.py: using CellId 26139 04:54:53.535402 tst handover.py: using BVCI 26140 04:54:53.645398 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:53.656455 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:53.667269 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:53.678402 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:53.689491 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:53.700276 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 04:54:53.817347 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 04:54:53.932185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:54.375334 run create_hlr_db(pid=29296): Launched 04:54:54.490454 bus /sierra_2: Setting Powered False 04:54:55.550317 run create_hlr_db(pid=29296): Terminated: ok {rc=0} 04:54:55.962642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29298): Launched 04:54:56.286137 run osmo-hlr_10.42.42.2(pid=29299): Launched 04:54:56.409510 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:56.939338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29301): Launched 04:54:57.262650 run osmo-stp_10.42.42.5(pid=29302): Launched 04:54:57.385974 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:57.940562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29304): Launched 04:54:58.263206 run osmo-msc_10.42.42.6(pid=29305): Launched 04:54:58.443037 run osmo-stp_10.42.42.5(pid=29302): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29302)] 04:54:58.578827 run osmo-stp_10.42.42.5(pid=29302): stdout: | (launched: 2022-12-10_04:54:57.203678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:58.714887 run osmo-stp_10.42.42.5(pid=29302): stderr: | 20221210045457396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045457396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045457397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045457397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045457397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045457397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045457397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:58.849883 run osmo-stp_10.42.42.5(pid=29302): stdout: | (launched: 2022-12-10_04:54:57.203678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:58.978278 run osmo-stp_10.42.42.5(pid=29302): stderr: | 20221210045457396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045457396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045457397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045457397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045457397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045457397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045457397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:59.132072 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29302): Process ended prematurely: osmo-stp_10.42.42.5(pid=29302) [trial-2369↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29302)] [trial-2369↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 04:54:59.141023 tst handover.py:18: Test FAILED (6.5 sec) 04:54:59.168266 run osmo-hlr_10.42.42.2(pid=29299): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29299)] 04:54:59.217601 run osmo-hlr_10.42.42.2(pid=29299): stdout: | (launched: 2022-12-10_04:54:56.227677) 04:54:59.269376 run osmo-hlr_10.42.42.2(pid=29299): stderr: | 20221210045456425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045456426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045456426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045456426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045456426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045456426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045456438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045456447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045456447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045456448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:59.340708 run osmo-msc_10.42.42.6(pid=29305): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29305)] 04:54:59.390354 run osmo-msc_10.42.42.6(pid=29305): stdout: | (launched: 2022-12-10_04:54:58.204408) 04:54:59.441384 run osmo-msc_10.42.42.6(pid=29305): stderr: | 20221210045458526 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045458526 DLGLOBAL DEBUG validating counter group 0x7fb55e486c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045458526 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045458527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045458527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045458527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045458529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045458529 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045458529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045458529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:59.492729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29298): Terminating (SIGTERM) 04:54:59.534040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29301): Terminating (SIGTERM) 04:54:59.575159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29304): Terminating (SIGTERM) 04:54:59.616565 --- ParallelTerminationStrategy: PID 29298 died... 04:54:59.636416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29298): Terminated: ok {rc=0} 04:54:59.682529 --- ParallelTerminationStrategy: PID 29301 died... 04:54:59.701696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29301): Terminated: ok {rc=0} 04:54:59.746908 --- ParallelTerminationStrategy: PID 29304 died... 04:54:59.766155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29304): Terminated: ok {rc=0} 04:54:59.852129 bus /sierra_3: Setting Powered False 04:55:00.968838 bus /sierra_3: Setting Powered False 04:55:02.082520 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 04:55:03.326529 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:03.331959 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:55:03.381133 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:55:03.407311 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:55:03.460287 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:55:03.510584 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:55:03.537105 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:55:04.084605 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 04:55:04.089798 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:55:04.100390 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:55:04.134114 tst handover.py: using LAC 26140 04:55:04.254806 tst handover.py: using RAC 130 04:55:04.374531 tst handover.py: using CellId 26140 04:55:04.494761 tst handover.py: using BVCI 26141 04:55:04.604132 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:55:04.651758 tst handover.py: using LAC 26141 04:55:04.770778 tst handover.py: using RAC 131 04:55:04.889370 tst handover.py: using CellId 26141 04:55:05.009536 tst handover.py: using BVCI 26142 04:55:05.128373 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:55:05.139981 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:55:05.151440 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:55:05.163115 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:55:05.174800 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:55:05.186361 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:55:05.305691 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:55:05.424552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:05.895656 run create_hlr_db(pid=29313): Launched 04:55:06.026488 bus /sierra_2: Setting Powered False 04:55:07.089640 run create_hlr_db(pid=29313): Terminated: ok {rc=0} 04:55:07.511462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29315): Launched 04:55:07.833793 run osmo-hlr_10.42.42.2(pid=29316): Launched 04:55:07.956607 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:08.488333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29318): Launched 04:55:08.810521 run osmo-stp_10.42.42.5(pid=29319): Launched 04:55:08.933386 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:09.489606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29321): Launched 04:55:09.811698 run osmo-msc_10.42.42.6(pid=29322): Launched 04:55:09.991884 run osmo-stp_10.42.42.5(pid=29319): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29319)] 04:55:10.129102 run osmo-stp_10.42.42.5(pid=29319): stdout: | (launched: 2022-12-10_04:55:08.751955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:10.265272 run osmo-stp_10.42.42.5(pid=29319): stderr: | 20221210045508945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045508945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045508945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045508946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045508946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045508946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045508946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:10.399898 run osmo-stp_10.42.42.5(pid=29319): stdout: | (launched: 2022-12-10_04:55:08.751955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:10.528650 run osmo-stp_10.42.42.5(pid=29319): stderr: | 20221210045508945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045508945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045508945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045508946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045508946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045508946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045508946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:10.682159 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29319): Process ended prematurely: osmo-stp_10.42.42.5(pid=29319) [trial-2369↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29319)] [trial-2369↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 04:55:10.691100 tst handover.py:18: Test FAILED (6.6 sec) 04:55:10.718640 run osmo-hlr_10.42.42.2(pid=29316): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29316)] 04:55:10.768598 run osmo-hlr_10.42.42.2(pid=29316): stdout: | (launched: 2022-12-10_04:55:07.775244) 04:55:10.820161 run osmo-hlr_10.42.42.2(pid=29316): stderr: | 20221210045507975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045507975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045507975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045507976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045507976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045507976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045507987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045507996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045507996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045507996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:10.891956 run osmo-msc_10.42.42.6(pid=29322): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29322)] 04:55:10.941553 run osmo-msc_10.42.42.6(pid=29322): stdout: | (launched: 2022-12-10_04:55:09.752702) 04:55:10.993249 run osmo-msc_10.42.42.6(pid=29322): stderr: | 20221210045510076 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045510076 DLGLOBAL DEBUG validating counter group 0x7f7412370c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045510076 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045510076 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045510076 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045510076 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045510078 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045510078 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045510079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045510079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:11.044682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29315): Terminating (SIGTERM) 04:55:11.086135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29318): Terminating (SIGTERM) 04:55:11.127669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29321): Terminating (SIGTERM) 04:55:11.169248 --- ParallelTerminationStrategy: PID 29315 died... 04:55:11.189193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29315): Terminated: ok {rc=0} 04:55:11.235232 --- ParallelTerminationStrategy: PID 29318 died... 04:55:11.254793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29318): Terminated: ok {rc=0} 04:55:11.300751 --- ParallelTerminationStrategy: PID 29321 died... 04:55:11.320357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29321): Terminated: ok {rc=0} 04:55:11.407883 bus /sierra_3: Setting Powered False 04:55:12.505308 bus /sierra_3: Setting Powered False 04:55:13.619900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 04:55:14.877613 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:14.883045 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:55:14.932570 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:55:14.960375 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:55:15.014421 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:55:15.064649 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:55:15.092312 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:55:15.643337 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 04:55:15.649021 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:15.660393 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:55:15.697902 tst handover.py: using LAC 26142 04:55:15.823806 tst handover.py: using RAC 132 04:55:15.967213 tst handover.py: using CellId 26142 04:55:16.089753 tst handover.py: using BVCI 26143 04:55:16.203172 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:55:16.254358 tst handover.py: using LAC 26143 04:55:16.413121 tst handover.py: using RAC 133 04:55:16.540888 tst handover.py: using CellId 26143 04:55:16.666291 tst handover.py: using BVCI 26144 04:55:16.779835 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:16.791766 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:16.803814 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:16.818570 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:16.831525 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:16.843247 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:55:16.977203 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:55:17.126916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:17.582581 run create_hlr_db(pid=29327): Launched 04:55:17.698263 bus /sierra_2: Setting Powered False 04:55:18.759214 run create_hlr_db(pid=29327): Terminated: ok {rc=0} 04:55:19.157230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29329): Launched 04:55:19.462255 run osmo-hlr_10.42.42.2(pid=29330): Launched 04:55:19.578578 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:20.086723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29332): Launched 04:55:20.390181 run osmo-stp_10.42.42.5(pid=29333): Launched 04:55:20.506305 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:21.030069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29335): Launched 04:55:21.333036 run osmo-msc_10.42.42.6(pid=29336): Launched 04:55:21.503722 run osmo-stp_10.42.42.5(pid=29333): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29333)] 04:55:21.633467 run osmo-stp_10.42.42.5(pid=29333): stdout: | (launched: 2022-12-10_04:55:20.335040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:21.762564 run osmo-stp_10.42.42.5(pid=29333): stderr: | 20221210045520503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045520504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045520504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045520504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045520507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045520507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045520507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:21.889405 run osmo-stp_10.42.42.5(pid=29333): stdout: | (launched: 2022-12-10_04:55:20.335040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:22.010189 run osmo-stp_10.42.42.5(pid=29333): stderr: | 20221210045520503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045520504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045520504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045520504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045520507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045520507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045520507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:22.154984 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29333): Process ended prematurely: osmo-stp_10.42.42.5(pid=29333) [trial-2369↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29333)] [trial-2369↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 04:55:22.163570 tst handover.py:18: Test FAILED (6.5 sec) 04:55:22.190395 run osmo-hlr_10.42.42.2(pid=29330): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29330)] 04:55:22.237905 run osmo-hlr_10.42.42.2(pid=29330): stdout: | (launched: 2022-12-10_04:55:19.406332) 04:55:22.286998 run osmo-hlr_10.42.42.2(pid=29330): stderr: | 20221210045519581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045519581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045519581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045519581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045519581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045519581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045519592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045519601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045519601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045519601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:22.355462 run osmo-msc_10.42.42.6(pid=29336): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29336)] 04:55:22.402857 run osmo-msc_10.42.42.6(pid=29336): stdout: | (launched: 2022-12-10_04:55:21.277897) 04:55:22.452004 run osmo-msc_10.42.42.6(pid=29336): stderr: | 20221210045521547 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045521547 DLGLOBAL DEBUG validating counter group 0x7fb7eec81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045521548 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045521548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045521548 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045521548 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045521551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045521552 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045521552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045521552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:22.501331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29329): Terminating (SIGTERM) 04:55:22.540711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29332): Terminating (SIGTERM) 04:55:22.580315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29335): Terminating (SIGTERM) 04:55:22.619767 --- ParallelTerminationStrategy: PID 29329 died... 04:55:22.638539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29329): Terminated: ok {rc=0} 04:55:22.683307 --- ParallelTerminationStrategy: PID 29332 died... 04:55:22.701853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29332): Terminated: ok {rc=0} 04:55:22.746145 --- ParallelTerminationStrategy: PID 29335 died... 04:55:22.764680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29335): Terminated: ok {rc=0} 04:55:22.848834 bus /sierra_3: Setting Powered False 04:55:23.946940 bus /sierra_3: Setting Powered False 04:55:25.064671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:55:26.316309 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:26.321444 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:55:26.379693 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:55:26.406299 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:55:26.459031 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:55:26.520080 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:55:26.547985 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:55:27.101479 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:55:27.107005 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:27.118779 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:55:27.168941 tst handover.py: using LAC 26144 04:55:27.295328 tst handover.py: using RAC 134 04:55:27.416187 tst handover.py: using CellId 26144 04:55:27.534970 tst handover.py: using BVCI 26145 04:55:27.645862 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:55:27.690048 tst handover.py: using LAC 26145 04:55:27.810710 tst handover.py: using RAC 135 04:55:27.930199 tst handover.py: using CellId 26145 04:55:28.049970 tst handover.py: using BVCI 26146 04:55:28.159273 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.170459 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.181554 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.192720 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.204024 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:28.215170 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:55:28.333913 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:55:28.452578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:28.925916 run create_hlr_db(pid=29341): Launched 04:55:29.058090 bus /sierra_2: Setting Powered False 04:55:30.122190 run create_hlr_db(pid=29341): Terminated: ok {rc=0} 04:55:30.543912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29343): Launched 04:55:30.873802 run osmo-hlr_10.42.42.2(pid=29344): Launched 04:55:31.201203 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:31.794099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29346): Launched 04:55:32.124049 run osmo-stp_10.42.42.5(pid=29347): Launched 04:55:32.331050 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:32.870161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29349): Launched 04:55:33.175076 run osmo-msc_10.42.42.6(pid=29350): Launched 04:55:33.344199 run osmo-stp_10.42.42.5(pid=29347): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29347)] 04:55:33.472118 run osmo-stp_10.42.42.5(pid=29347): stdout: | (launched: 2022-12-10_04:55:32.064561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:33.600756 run osmo-stp_10.42.42.5(pid=29347): stderr: | 20221210045532386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045532386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045532386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045532387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045532387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045532387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045532387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:33.727384 run osmo-stp_10.42.42.5(pid=29347): stdout: | (launched: 2022-12-10_04:55:32.064561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:33.848137 run osmo-stp_10.42.42.5(pid=29347): stderr: | 20221210045532386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045532386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045532386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045532387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045532387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045532387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045532387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:33.992706 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29347): Process ended prematurely: osmo-stp_10.42.42.5(pid=29347) [trial-2369↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29347)] [trial-2369↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 04:55:34.001309 tst handover.py:18: Test FAILED (6.9 sec) 04:55:34.027759 run osmo-hlr_10.42.42.2(pid=29344): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29344)] 04:55:34.075699 run osmo-hlr_10.42.42.2(pid=29344): stdout: | (launched: 2022-12-10_04:55:30.808282) 04:55:34.125226 run osmo-hlr_10.42.42.2(pid=29344): stderr: | 20221210045531140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045531140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045531140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045531140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045531140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045531140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045531158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045531178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045531179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045531179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:34.193915 run osmo-msc_10.42.42.6(pid=29350): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29350)] 04:55:34.241578 run osmo-msc_10.42.42.6(pid=29350): stdout: | (launched: 2022-12-10_04:55:33.119120) 04:55:34.291157 run osmo-msc_10.42.42.6(pid=29350): stderr: | 20221210045533391 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045533391 DLGLOBAL DEBUG validating counter group 0x7f4987612c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045533391 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045533391 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045533392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045533392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045533394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045533394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045533395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045533395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:34.340844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29343): Terminating (SIGTERM) 04:55:34.380710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29346): Terminating (SIGTERM) 04:55:34.420419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29349): Terminating (SIGTERM) 04:55:34.460534 --- ParallelTerminationStrategy: PID 29343 died... 04:55:34.479432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29343): Terminated: ok {rc=0} 04:55:34.523890 --- ParallelTerminationStrategy: PID 29346 died... 04:55:34.542598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29346): Terminated: ok {rc=0} 04:55:34.586875 --- ParallelTerminationStrategy: PID 29349 died... 04:55:34.605529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29349): Terminated: ok {rc=0} 04:55:34.689164 bus /sierra_3: Setting Powered False 04:55:35.786586 bus /sierra_3: Setting Powered False 04:55:36.904199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:55:38.172397 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:38.177653 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:55:38.240914 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:55:38.267923 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:55:38.319508 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:55:38.383368 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:55:38.410203 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:55:38.960006 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:55:38.965428 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:38.976505 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:55:39.023327 tst handover.py: using LAC 26146 04:55:39.143443 tst handover.py: using RAC 136 04:55:39.261370 tst handover.py: using CellId 26146 04:55:39.379937 tst handover.py: using BVCI 26147 04:55:39.489658 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:55:39.537493 tst handover.py: using LAC 26147 04:55:39.669806 tst handover.py: using RAC 137 04:55:39.795765 tst handover.py: using CellId 26147 04:55:39.920705 tst handover.py: using BVCI 26148 04:55:40.038420 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.049892 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.061493 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.072741 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.084052 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:40.095367 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:55:40.209289 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:55:40.325554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:40.799917 run create_hlr_db(pid=29355): Launched 04:55:40.930997 bus /sierra_2: Setting Powered False 04:55:41.994901 run create_hlr_db(pid=29355): Terminated: ok {rc=0} 04:55:42.417186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29357): Launched 04:55:42.739749 run osmo-hlr_10.42.42.2(pid=29358): Launched 04:55:42.862641 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:43.395079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29360): Launched 04:55:43.717822 run osmo-stp_10.42.42.5(pid=29361): Launched 04:55:43.841080 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:44.397307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29363): Launched 04:55:44.721091 run osmo-msc_10.42.42.6(pid=29364): Launched 04:55:44.900366 run osmo-stp_10.42.42.5(pid=29361): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29361)] 04:55:45.036486 run osmo-stp_10.42.42.5(pid=29361): stdout: | (launched: 2022-12-10_04:55:43.659038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:45.172444 run osmo-stp_10.42.42.5(pid=29361): stderr: | 20221210045543850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045543850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045543850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045543851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045543853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045543853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045543853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:45.307465 run osmo-stp_10.42.42.5(pid=29361): stdout: | (launched: 2022-12-10_04:55:43.659038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:45.436162 run osmo-stp_10.42.42.5(pid=29361): stderr: | 20221210045543850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045543850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045543850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045543851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045543853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045543853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045543853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:45.589897 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29361): Process ended prematurely: osmo-stp_10.42.42.5(pid=29361) [trial-2369↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29361)] [trial-2369↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 04:55:45.598834 tst handover.py:18: Test FAILED (6.6 sec) 04:55:45.626655 run osmo-hlr_10.42.42.2(pid=29358): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29358)] 04:55:45.676858 run osmo-hlr_10.42.42.2(pid=29358): stdout: | (launched: 2022-12-10_04:55:42.681155) 04:55:45.728538 run osmo-hlr_10.42.42.2(pid=29358): stderr: | 20221210045542880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045542880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045542880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045542880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045542880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045542880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045542892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045542900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045542900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045542900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:45.800403 run osmo-msc_10.42.42.6(pid=29364): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29364)] 04:55:45.854620 run osmo-msc_10.42.42.6(pid=29364): stdout: | (launched: 2022-12-10_04:55:44.662100) 04:55:45.916660 run osmo-msc_10.42.42.6(pid=29364): stderr: | 20221210045544983 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045544983 DLGLOBAL DEBUG validating counter group 0x7fd5d2bf3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045544983 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045544983 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045544984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045544984 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045544985 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045544986 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045544986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045544986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:45.970049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29357): Terminating (SIGTERM) 04:55:46.013678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29360): Terminating (SIGTERM) 04:55:46.057829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29363): Terminating (SIGTERM) 04:55:46.102403 --- ParallelTerminationStrategy: PID 29357 died... 04:55:46.123127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29357): Terminated: ok {rc=0} 04:55:46.170018 --- ParallelTerminationStrategy: PID 29360 died... 04:55:46.190173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29360): Terminated: ok {rc=0} 04:55:46.237226 --- ParallelTerminationStrategy: PID 29363 died... 04:55:46.257338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29363): Terminated: ok {rc=0} 04:55:46.345706 bus /sierra_3: Setting Powered False 04:55:47.444745 bus /sierra_3: Setting Powered False 04:55:48.559725 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 04:55:49.839604 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:49.845309 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:55:49.896866 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:55:49.924235 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:55:49.975709 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:55:50.027242 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:55:50.054713 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:55:50.607760 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 04:55:50.613584 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:50.624933 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 04:55:50.673943 tst handover.py: using LAC 26148 04:55:50.798768 tst handover.py: using RAC 138 04:55:50.923451 tst handover.py: using CellId 26148 04:55:51.048359 tst handover.py: using BVCI 26149 04:55:51.158808 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 04:55:51.192380 tst handover.py: using LAC 26149 04:55:51.314049 tst handover.py: using RAC 139 04:55:51.433157 tst handover.py: using CellId 26149 04:55:51.550606 tst handover.py: using BVCI 26150 04:55:51.661079 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:51.671845 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:51.682526 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:51.693876 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:51.705398 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:51.716584 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 04:55:51.834405 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 04:55:51.953495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:52.426744 run create_hlr_db(pid=29369): Launched 04:55:52.557823 bus /sierra_2: Setting Powered False 04:55:53.621999 run create_hlr_db(pid=29369): Terminated: ok {rc=0} 04:55:54.029246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29371): Launched 04:55:54.333452 run osmo-hlr_10.42.42.2(pid=29372): Launched 04:55:54.451103 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:54.968484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29374): Launched 04:55:55.271900 run osmo-stp_10.42.42.5(pid=29375): Launched 04:55:55.389430 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:55.913352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29377): Launched 04:55:56.217030 run osmo-msc_10.42.42.6(pid=29378): Launched 04:55:56.387925 run osmo-stp_10.42.42.5(pid=29375): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29375)] 04:55:56.517186 run osmo-stp_10.42.42.5(pid=29375): stdout: | (launched: 2022-12-10_04:55:55.216502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:56.645694 run osmo-stp_10.42.42.5(pid=29375): stderr: | 20221210045555386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045555386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045555386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045555387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045555387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045555387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045555387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:56.771880 run osmo-stp_10.42.42.5(pid=29375): stdout: | (launched: 2022-12-10_04:55:55.216502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:56.892233 run osmo-stp_10.42.42.5(pid=29375): stderr: | 20221210045555386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045555386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045555386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045555387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045555387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045555387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045555387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:57.036510 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29375): Process ended prematurely: osmo-stp_10.42.42.5(pid=29375) [trial-2369↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29375)] [trial-2369↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 04:55:57.045027 tst handover.py:18: Test FAILED (6.4 sec) 04:55:57.071416 run osmo-hlr_10.42.42.2(pid=29372): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29372)] 04:55:57.119661 run osmo-hlr_10.42.42.2(pid=29372): stdout: | (launched: 2022-12-10_04:55:54.278102) 04:55:57.168834 run osmo-hlr_10.42.42.2(pid=29372): stderr: | 20221210045554455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045554455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045554455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045554455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045554455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045554455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045554468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045554477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045554477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045554477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:57.237779 run osmo-msc_10.42.42.6(pid=29378): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29378)] 04:55:57.285797 run osmo-msc_10.42.42.6(pid=29378): stdout: | (launched: 2022-12-10_04:55:56.161500) 04:55:57.334788 run osmo-msc_10.42.42.6(pid=29378): stderr: | 20221210045556431 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045556431 DLGLOBAL DEBUG validating counter group 0x7ff8809f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045556431 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045556431 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045556432 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045556432 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045556434 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045556434 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045556434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045556434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:57.384167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29371): Terminating (SIGTERM) 04:55:57.423704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29374): Terminating (SIGTERM) 04:55:57.463350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29377): Terminating (SIGTERM) 04:55:57.503930 --- ParallelTerminationStrategy: PID 29371 died... 04:55:57.522998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29371): Terminated: ok {rc=0} 04:55:57.567294 --- ParallelTerminationStrategy: PID 29374 died... 04:55:57.585793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29374): Terminated: ok {rc=0} 04:55:57.630043 --- ParallelTerminationStrategy: PID 29377 died... 04:55:57.648549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29377): Terminated: ok {rc=0} 04:55:57.731880 bus /sierra_3: Setting Powered False 04:55:58.830080 bus /sierra_3: Setting Powered False 04:55:59.945597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 04:56:01.196819 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:01.202829 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:56:01.273190 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:56:01.301904 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:56:01.353238 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:56:01.437327 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:56:01.472744 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:56:02.035953 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 04:56:02.044498 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:02.061222 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:02.125799 tst handover.py: using LAC 26150 04:56:02.258201 tst handover.py: using RAC 140 04:56:02.392716 tst handover.py: using CellId 26150 04:56:02.512191 tst handover.py: using BVCI 26151 04:56:02.621472 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:02.668127 tst handover.py: using LAC 26151 04:56:02.784797 tst handover.py: using RAC 141 04:56:02.901675 tst handover.py: using CellId 26151 04:56:03.020750 tst handover.py: using BVCI 26152 04:56:03.130517 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.141395 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.152005 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.162922 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.173907 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:03.184572 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:03.301723 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:03.420585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:03.895123 run create_hlr_db(pid=29383): Launched 04:56:04.026560 bus /sierra_2: Setting Powered False 04:56:05.090166 run create_hlr_db(pid=29383): Terminated: ok {rc=0} 04:56:05.497879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29385): Launched 04:56:05.803338 run osmo-hlr_10.42.42.2(pid=29386): Launched 04:56:05.919904 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:06.432864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29388): Launched 04:56:06.735587 run osmo-stp_10.42.42.5(pid=29389): Launched 04:56:06.851465 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:07.377293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29391): Launched 04:56:07.681273 run osmo-msc_10.42.42.6(pid=29392): Launched 04:56:07.852371 run osmo-stp_10.42.42.5(pid=29389): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29389)] 04:56:07.981396 run osmo-stp_10.42.42.5(pid=29389): stdout: | (launched: 2022-12-10_04:56:06.680297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:08.110219 run osmo-stp_10.42.42.5(pid=29389): stderr: | 20221210045606849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045606849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045606849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045606850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045606852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045606852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045606852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:08.236677 run osmo-stp_10.42.42.5(pid=29389): stdout: | (launched: 2022-12-10_04:56:06.680297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:08.357707 run osmo-stp_10.42.42.5(pid=29389): stderr: | 20221210045606849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045606849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045606849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045606850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045606852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045606852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045606852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:08.502076 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29389): Process ended prematurely: osmo-stp_10.42.42.5(pid=29389) [trial-2369↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29389)] [trial-2369↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 04:56:08.510373 tst handover.py:18: Test FAILED (6.5 sec) 04:56:08.536563 run osmo-hlr_10.42.42.2(pid=29386): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29386)] 04:56:08.584036 run osmo-hlr_10.42.42.2(pid=29386): stdout: | (launched: 2022-12-10_04:56:05.747271) 04:56:08.633059 run osmo-hlr_10.42.42.2(pid=29386): stderr: | 20221210045605923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045605923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045605923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045605923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045605923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045605923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045605936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045605946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045605946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045605946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:08.701435 run osmo-msc_10.42.42.6(pid=29392): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29392)] 04:56:08.748673 run osmo-msc_10.42.42.6(pid=29392): stdout: | (launched: 2022-12-10_04:56:07.625534) 04:56:08.797645 run osmo-msc_10.42.42.6(pid=29392): stderr: | 20221210045607895 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045607895 DLGLOBAL DEBUG validating counter group 0x7f37df2c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045607895 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045607895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045607895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045607896 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045607898 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045607898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045607898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045607898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:08.847211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29385): Terminating (SIGTERM) 04:56:08.886416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29388): Terminating (SIGTERM) 04:56:08.925759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29391): Terminating (SIGTERM) 04:56:08.965477 --- ParallelTerminationStrategy: PID 29385 died... 04:56:08.984159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29385): Terminated: ok {rc=0} 04:56:09.028244 --- ParallelTerminationStrategy: PID 29388 died... 04:56:09.046617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29388): Terminated: ok {rc=0} 04:56:09.090457 --- ParallelTerminationStrategy: PID 29391 died... 04:56:09.109099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29391): Terminated: ok {rc=0} 04:56:09.194125 bus /sierra_3: Setting Powered False 04:56:10.293628 bus /sierra_3: Setting Powered False 04:56:11.410127 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 04:56:12.676156 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:12.681340 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:56:12.742845 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:56:12.769146 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:56:12.821592 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:56:12.884860 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:56:12.911561 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:56:13.459201 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 04:56:13.464236 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:13.475194 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:56:13.522716 tst handover.py: using LAC 26152 04:56:13.643131 tst handover.py: using RAC 142 04:56:13.763010 tst handover.py: using CellId 26152 04:56:13.882542 tst handover.py: using BVCI 26153 04:56:13.994352 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:56:14.041452 tst handover.py: using LAC 26153 04:56:14.162867 tst handover.py: using RAC 143 04:56:14.283579 tst handover.py: using CellId 26153 04:56:14.402581 tst handover.py: using BVCI 26154 04:56:14.512328 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.523147 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.533767 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.544596 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.555453 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:14.566341 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:56:14.683845 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:56:14.800168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:15.272767 run create_hlr_db(pid=29397): Launched 04:56:15.405795 bus /sierra_2: Setting Powered False 04:56:16.466258 run create_hlr_db(pid=29397): Terminated: ok {rc=0} 04:56:16.947663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Launched 04:56:17.286522 run osmo-hlr_10.42.42.2(pid=29400): Launched 04:56:17.410016 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:17.939059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Launched 04:56:18.262944 run osmo-stp_10.42.42.5(pid=29403): Launched 04:56:18.385876 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:18.942031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29405): Launched 04:56:19.264872 run osmo-msc_10.42.42.6(pid=29406): Launched 04:56:19.444617 run osmo-stp_10.42.42.5(pid=29403): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] 04:56:19.580266 run osmo-stp_10.42.42.5(pid=29403): stdout: | (launched: 2022-12-10_04:56:18.204074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:19.716424 run osmo-stp_10.42.42.5(pid=29403): stderr: | 20221210045618397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045618397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045618397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045618398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045618398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045618398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045618398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:19.851931 run osmo-stp_10.42.42.5(pid=29403): stdout: | (launched: 2022-12-10_04:56:18.204074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:19.981220 run osmo-stp_10.42.42.5(pid=29403): stderr: | 20221210045618397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045618397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045618397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045618398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045618398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045618398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045618398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:20.135766 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29403): Process ended prematurely: osmo-stp_10.42.42.5(pid=29403) [trial-2369↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] [trial-2369↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 04:56:20.144896 tst handover.py:18: Test FAILED (6.7 sec) 04:56:20.172527 run osmo-hlr_10.42.42.2(pid=29400): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29400)] 04:56:20.222689 run osmo-hlr_10.42.42.2(pid=29400): stdout: | (launched: 2022-12-10_04:56:17.227560) 04:56:20.274465 run osmo-hlr_10.42.42.2(pid=29400): stderr: | 20221210045617426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045617426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045617426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045617427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045617427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045617427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045617439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045617448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045617448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045617448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:20.346827 run osmo-msc_10.42.42.6(pid=29406): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29406)] 04:56:20.396651 run osmo-msc_10.42.42.6(pid=29406): stdout: | (launched: 2022-12-10_04:56:19.205959) 04:56:20.447976 run osmo-msc_10.42.42.6(pid=29406): stderr: | 20221210045619529 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045619529 DLGLOBAL DEBUG validating counter group 0x7f87d25a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045619529 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045619530 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045619530 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045619530 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045619532 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045619532 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045619532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045619532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:20.499659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Terminating (SIGTERM) 04:56:20.540859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Terminating (SIGTERM) 04:56:20.582326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29405): Terminating (SIGTERM) 04:56:20.623712 --- ParallelTerminationStrategy: PID 29399 died... 04:56:20.643555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Terminated: ok {rc=0} 04:56:20.689593 --- ParallelTerminationStrategy: PID 29402 died... 04:56:20.709103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Terminated: ok {rc=0} 04:56:20.754704 --- ParallelTerminationStrategy: PID 29405 died... 04:56:20.774183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29405): Terminated: ok {rc=0} 04:56:20.861827 bus /sierra_3: Setting Powered False 04:56:21.960641 bus /sierra_3: Setting Powered False 04:56:23.075310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:56:24.348365 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:24.354385 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:56:24.413715 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:56:24.440211 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:56:24.491839 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:56:24.551378 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:56:24.577859 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:56:25.131312 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:56:25.136422 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:25.147630 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:56:25.191691 tst handover.py: using LAC 26154 04:56:25.322089 tst handover.py: using RAC 144 04:56:25.451037 tst handover.py: using CellId 26154 04:56:25.579535 tst handover.py: using BVCI 26155 04:56:25.698164 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:56:25.749471 tst handover.py: using LAC 26155 04:56:25.877086 tst handover.py: using RAC 145 04:56:26.003701 tst handover.py: using CellId 26155 04:56:26.132905 tst handover.py: using BVCI 26156 04:56:26.251213 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:26.262896 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:26.274357 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:26.285889 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:26.297498 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:26.308935 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:56:26.423833 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:56:26.537316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:26.983227 run create_hlr_db(pid=29411): Launched 04:56:27.099720 bus /sierra_2: Setting Powered False 04:56:28.160504 run create_hlr_db(pid=29411): Terminated: ok {rc=0} 04:56:28.575371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29413): Launched 04:56:28.898316 run osmo-hlr_10.42.42.2(pid=29414): Launched 04:56:29.021528 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:29.556031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29416): Launched 04:56:29.879020 run osmo-stp_10.42.42.5(pid=29417): Launched 04:56:30.003077 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:30.561392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29419): Launched 04:56:30.889713 run osmo-msc_10.42.42.6(pid=29420): Launched 04:56:31.366034 run osmo-stp_10.42.42.5(pid=29417): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29417)] 04:56:31.695610 run osmo-stp_10.42.42.5(pid=29417): stdout: | (launched: 2022-12-10_04:56:29.819957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:31.833337 run osmo-stp_10.42.42.5(pid=29417): stderr: | 20221210045630011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045630012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045630012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045630012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045630013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045630013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045630013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:31.969394 run osmo-stp_10.42.42.5(pid=29417): stdout: | (launched: 2022-12-10_04:56:29.819957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:32.102459 run osmo-stp_10.42.42.5(pid=29417): stderr: | 20221210045630011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045630012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045630012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045630012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045630013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045630013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045630013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:32.258417 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29417): Process ended prematurely: osmo-stp_10.42.42.5(pid=29417) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29417)] [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 04:56:32.267789 tst handover.py:18: Test FAILED (7.1 sec) 04:56:32.296380 run osmo-hlr_10.42.42.2(pid=29414): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29414)] 04:56:32.347216 run osmo-hlr_10.42.42.2(pid=29414): stdout: | (launched: 2022-12-10_04:56:28.839632) 04:56:32.399724 run osmo-hlr_10.42.42.2(pid=29414): stderr: | 20221210045629038 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045629038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045629038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045629038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045629038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045629039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045629052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045629060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045629060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045629060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:32.472057 run osmo-msc_10.42.42.6(pid=29420): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29420)] 04:56:32.522137 run osmo-msc_10.42.42.6(pid=29420): stdout: | (launched: 2022-12-10_04:56:30.824668) 04:56:32.573721 run osmo-msc_10.42.42.6(pid=29420): stderr: | 20221210045631388 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045631389 DLGLOBAL DEBUG validating counter group 0x7f5c800e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045631389 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045631389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045631390 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045631391 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045631397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045631399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045631399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045631399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:32.625725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29413): Terminating (SIGTERM) 04:56:32.667320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29416): Terminating (SIGTERM) 04:56:32.709076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29419): Terminating (SIGTERM) 04:56:32.751053 --- ParallelTerminationStrategy: PID 29413 died... 04:56:32.771079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29413): Terminated: ok {rc=0} 04:56:32.817500 --- ParallelTerminationStrategy: PID 29416 died... 04:56:32.837146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29416): Terminated: ok {rc=0} 04:56:32.883204 --- ParallelTerminationStrategy: PID 29419 died... 04:56:32.902689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29419): Terminated: ok {rc=0} 04:56:32.989966 bus /sierra_3: Setting Powered False 04:56:34.088899 bus /sierra_3: Setting Powered False 04:56:35.203918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 04:56:36.472836 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:36.478046 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:56:36.524589 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:56:36.551160 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:56:36.600736 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:56:36.647159 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:56:36.673697 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:56:37.230211 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 04:56:37.235461 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:37.246604 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 04:56:37.290826 tst handover.py: using LAC 26156 04:56:37.409589 tst handover.py: using RAC 146 04:56:37.537167 tst handover.py: using CellId 26156 04:56:37.662311 tst handover.py: using BVCI 26157 04:56:37.780831 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 04:56:37.820030 tst handover.py: using LAC 26157 04:56:37.945593 tst handover.py: using RAC 147 04:56:38.066320 tst handover.py: using CellId 26157 04:56:38.185366 tst handover.py: using BVCI 26158 04:56:38.295780 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:38.307051 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:38.318159 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:38.330229 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:38.342200 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:38.354028 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 04:56:38.471634 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 04:56:38.590181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:39.061622 run create_hlr_db(pid=29425): Launched 04:56:39.193247 bus /sierra_2: Setting Powered False 04:56:40.257376 run create_hlr_db(pid=29425): Terminated: ok {rc=0} 04:56:40.663096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Launched 04:56:40.965929 run osmo-hlr_10.42.42.2(pid=29428): Launched 04:56:41.083771 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:41.593388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Launched 04:56:41.895981 run osmo-stp_10.42.42.5(pid=29431): Launched 04:56:42.011730 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:42.534129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29433): Launched 04:56:42.837108 run osmo-msc_10.42.42.6(pid=29434): Launched 04:56:43.006523 run osmo-stp_10.42.42.5(pid=29431): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] 04:56:43.135549 run osmo-stp_10.42.42.5(pid=29431): stdout: | (launched: 2022-12-10_04:56:41.840497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:43.264374 run osmo-stp_10.42.42.5(pid=29431): stderr: | 20221210045642009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045642009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045642009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045642010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045642010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045642010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045642010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:43.390562 run osmo-stp_10.42.42.5(pid=29431): stdout: | (launched: 2022-12-10_04:56:41.840497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:43.511105 run osmo-stp_10.42.42.5(pid=29431): stderr: | 20221210045642009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045642009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045642009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045642010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045642010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045642010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045642010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:43.655152 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29431): Process ended prematurely: osmo-stp_10.42.42.5(pid=29431) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 04:56:43.663597 tst handover.py:18: Test FAILED (6.4 sec) 04:56:43.690111 run osmo-hlr_10.42.42.2(pid=29428): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29428)] 04:56:43.737673 run osmo-hlr_10.42.42.2(pid=29428): stdout: | (launched: 2022-12-10_04:56:40.910693) 04:56:43.786821 run osmo-hlr_10.42.42.2(pid=29428): stderr: | 20221210045641088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045641088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045641088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045641088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045641088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045641088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045641100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045641109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045641109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045641109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:43.855130 run osmo-msc_10.42.42.6(pid=29434): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29434)] 04:56:43.902376 run osmo-msc_10.42.42.6(pid=29434): stdout: | (launched: 2022-12-10_04:56:42.781162) 04:56:43.951488 run osmo-msc_10.42.42.6(pid=29434): stderr: | 20221210045643053 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045643053 DLGLOBAL DEBUG validating counter group 0x7fbdf01eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045643053 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045643053 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045643053 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045643053 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045643055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045643055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045643056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045643056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:44.000884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Terminating (SIGTERM) 04:56:44.040439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Terminating (SIGTERM) 04:56:44.080282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29433): Terminating (SIGTERM) 04:56:44.120206 --- ParallelTerminationStrategy: PID 29427 died... 04:56:44.139216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Terminated: ok {rc=0} 04:56:44.183498 --- ParallelTerminationStrategy: PID 29430 died... 04:56:44.202087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Terminated: ok {rc=0} 04:56:44.245880 --- ParallelTerminationStrategy: PID 29433 died... 04:56:44.264190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29433): Terminated: ok {rc=0} 04:56:44.346421 bus /sierra_3: Setting Powered False 04:56:45.440753 bus /sierra_3: Setting Powered False 04:56:46.557432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 04:56:47.826524 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:47.831583 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:56:47.889968 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:56:47.916579 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:56:47.969207 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:56:48.028594 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:56:48.055313 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:56:48.606152 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 04:56:48.611194 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:48.622301 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:48.665729 tst handover.py: using LAC 26158 04:56:48.784115 tst handover.py: using RAC 148 04:56:48.903305 tst handover.py: using CellId 26158 04:56:49.024139 tst handover.py: using BVCI 26159 04:56:49.133933 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:49.181619 tst handover.py: using LAC 26159 04:56:49.310134 tst handover.py: using RAC 149 04:56:49.438291 tst handover.py: using CellId 26159 04:56:49.566076 tst handover.py: using BVCI 26160 04:56:49.685116 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:49.696782 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:49.708305 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:49.719800 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:49.731242 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:49.742698 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:49.856034 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:49.970863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:50.413815 run create_hlr_db(pid=29439): Launched 04:56:50.529811 bus /sierra_2: Setting Powered False 04:56:51.591402 run create_hlr_db(pid=29439): Terminated: ok {rc=0} 04:56:51.987092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29441): Launched 04:56:52.291059 run osmo-hlr_10.42.42.2(pid=29442): Launched 04:56:52.406419 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:52.918848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29444): Launched 04:56:53.220556 run osmo-stp_10.42.42.5(pid=29445): Launched 04:56:53.336178 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:53.857588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29447): Launched 04:56:54.160340 run osmo-msc_10.42.42.6(pid=29448): Launched 04:56:54.329305 run osmo-stp_10.42.42.5(pid=29445): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29445)] 04:56:54.457266 run osmo-stp_10.42.42.5(pid=29445): stdout: | (launched: 2022-12-10_04:56:53.164783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:54.584921 run osmo-stp_10.42.42.5(pid=29445): stderr: | 20221210045653335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045653336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045653336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045653336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045653337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045653337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045653337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:54.710620 run osmo-stp_10.42.42.5(pid=29445): stdout: | (launched: 2022-12-10_04:56:53.164783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:54.830950 run osmo-stp_10.42.42.5(pid=29445): stderr: | 20221210045653335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045653336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045653336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045653336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045653337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045653337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045653337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:54.974313 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29445): Process ended prematurely: osmo-stp_10.42.42.5(pid=29445) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29445)] [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 04:56:54.982742 tst handover.py:18: Test FAILED (6.4 sec) 04:56:55.009129 run osmo-hlr_10.42.42.2(pid=29442): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29442)] 04:56:55.056530 run osmo-hlr_10.42.42.2(pid=29442): stdout: | (launched: 2022-12-10_04:56:52.235488) 04:56:55.105336 run osmo-hlr_10.42.42.2(pid=29442): stderr: | 20221210045652410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045652410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045652410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045652410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045652410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045652410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045652422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045652433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045652433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045652434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:55.173957 run osmo-msc_10.42.42.6(pid=29448): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29448)] 04:56:55.221353 run osmo-msc_10.42.42.6(pid=29448): stdout: | (launched: 2022-12-10_04:56:54.104392) 04:56:55.270475 run osmo-msc_10.42.42.6(pid=29448): stderr: | 20221210045654376 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045654377 DLGLOBAL DEBUG validating counter group 0x7ff2ef33ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045654377 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045654377 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045654377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045654377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045654379 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045654379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045654380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045654380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:55.319455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29441): Terminating (SIGTERM) 04:56:55.358649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29444): Terminating (SIGTERM) 04:56:55.398014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29447): Terminating (SIGTERM) 04:56:55.437423 --- ParallelTerminationStrategy: PID 29441 died... 04:56:55.456198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29441): Terminated: ok {rc=0} 04:56:55.500176 --- ParallelTerminationStrategy: PID 29444 died... 04:56:55.518518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29444): Terminated: ok {rc=0} 04:56:55.562100 --- ParallelTerminationStrategy: PID 29447 died... 04:56:55.580525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29447): Terminated: ok {rc=0} 04:56:55.662730 bus /sierra_3: Setting Powered False 04:56:56.759797 bus /sierra_3: Setting Powered False 04:56:57.874309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 04:56:59.146798 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:59.152468 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:56:59.211514 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:56:59.238865 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:56:59.291425 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:56:59.351178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:56:59.378566 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:56:59.929538 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 04:56:59.934742 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:59.946066 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:56:59.990653 tst handover.py: using LAC 26160 04:57:00.109808 tst handover.py: using RAC 150 04:57:00.238600 tst handover.py: using CellId 26160 04:57:00.366877 tst handover.py: using BVCI 26161 04:57:00.483831 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:00.533224 tst handover.py: using LAC 26161 04:57:00.661471 tst handover.py: using RAC 151 04:57:00.792153 tst handover.py: using CellId 26161 04:57:00.931094 tst handover.py: using BVCI 26162 04:57:01.051144 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:01.063755 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:01.076192 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:01.088868 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:01.101183 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:01.113462 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:01.233753 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:01.369744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:01.899738 run create_hlr_db(pid=29453): Launched 04:57:02.059572 bus /sierra_2: Setting Powered False 04:57:03.124191 run create_hlr_db(pid=29453): Terminated: ok {rc=0} 04:57:03.532443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29455): Launched 04:57:03.838425 run osmo-hlr_10.42.42.2(pid=29456): Launched 04:57:03.954716 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:04.470244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29458): Launched 04:57:04.774149 run osmo-stp_10.42.42.5(pid=29459): Launched 04:57:04.889989 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:05.410412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29461): Launched 04:57:05.713959 run osmo-msc_10.42.42.6(pid=29462): Launched 04:57:05.883891 run osmo-stp_10.42.42.5(pid=29459): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29459)] 04:57:06.012458 run osmo-stp_10.42.42.5(pid=29459): stdout: | (launched: 2022-12-10_04:57:04.718495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:06.141301 run osmo-stp_10.42.42.5(pid=29459): stderr: | 20221210045704889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045704889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045704889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045704890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045704890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045704890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045704890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:06.267670 run osmo-stp_10.42.42.5(pid=29459): stdout: | (launched: 2022-12-10_04:57:04.718495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:06.388516 run osmo-stp_10.42.42.5(pid=29459): stderr: | 20221210045704889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045704889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045704889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045704890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045704890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045704890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045704890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:06.532362 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29459): Process ended prematurely: osmo-stp_10.42.42.5(pid=29459) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29459)] [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 04:57:06.540856 tst handover.py:18: Test FAILED (6.6 sec) 04:57:06.567871 run osmo-hlr_10.42.42.2(pid=29456): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29456)] 04:57:06.615665 run osmo-hlr_10.42.42.2(pid=29456): stdout: | (launched: 2022-12-10_04:57:03.782721) 04:57:06.665157 run osmo-hlr_10.42.42.2(pid=29456): stderr: | 20221210045703959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045703960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045703960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045703960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045703960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045703960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045703972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045703981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045703981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045703981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:06.734015 run osmo-msc_10.42.42.6(pid=29462): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29462)] 04:57:06.781513 run osmo-msc_10.42.42.6(pid=29462): stdout: | (launched: 2022-12-10_04:57:05.658521) 04:57:06.830767 run osmo-msc_10.42.42.6(pid=29462): stderr: | 20221210045705930 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045705930 DLGLOBAL DEBUG validating counter group 0x7fbbd3cf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045705930 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045705931 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045705931 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045705931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045705933 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045705934 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045705934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045705934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:06.880274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29455): Terminating (SIGTERM) 04:57:06.919656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29458): Terminating (SIGTERM) 04:57:06.958829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29461): Terminating (SIGTERM) 04:57:06.998334 --- ParallelTerminationStrategy: PID 29455 died... 04:57:07.017408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29455): Terminated: ok {rc=0} 04:57:07.061800 --- ParallelTerminationStrategy: PID 29458 died... 04:57:07.080193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29458): Terminated: ok {rc=0} 04:57:07.124420 --- ParallelTerminationStrategy: PID 29461 died... 04:57:07.143092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29461): Terminated: ok {rc=0} 04:57:07.227917 bus /sierra_3: Setting Powered False 04:57:08.325153 bus /sierra_3: Setting Powered False 04:57:09.438805 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 04:57:10.700624 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:10.705860 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:57:10.756590 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:57:10.783082 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:57:10.835839 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:57:10.886760 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:57:10.913262 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:57:11.462796 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 04:57:11.467825 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:11.478800 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 04:57:11.526103 tst handover.py: using LAC 26162 04:57:11.646623 tst handover.py: using RAC 152 04:57:11.768497 tst handover.py: using CellId 26162 04:57:11.888611 tst handover.py: using BVCI 26163 04:57:11.998227 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 04:57:12.032659 tst handover.py: using LAC 26163 04:57:12.151280 tst handover.py: using RAC 153 04:57:12.270333 tst handover.py: using CellId 26163 04:57:12.391054 tst handover.py: using BVCI 26164 04:57:12.502370 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:12.513315 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:12.524016 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:12.534968 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:12.546077 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:12.556910 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 04:57:12.674467 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 04:57:12.789568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:13.235291 run create_hlr_db(pid=29467): Launched 04:57:13.351081 bus /sierra_2: Setting Powered False 04:57:14.411911 run create_hlr_db(pid=29467): Terminated: ok {rc=0} 04:57:14.826884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29469): Launched 04:57:15.151729 run osmo-hlr_10.42.42.2(pid=29470): Launched 04:57:15.275467 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:15.804490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29472): Launched 04:57:16.164745 run osmo-stp_10.42.42.5(pid=29473): Launched 04:57:16.350716 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:17.002493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29475): Launched 04:57:17.329874 run osmo-msc_10.42.42.6(pid=29476): Launched 04:57:17.502341 run osmo-stp_10.42.42.5(pid=29473): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29473)] 04:57:17.631632 run osmo-stp_10.42.42.5(pid=29473): stdout: | (launched: 2022-12-10_04:57:16.103966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:17.760519 run osmo-stp_10.42.42.5(pid=29473): stderr: | 20221210045716472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045716472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045716472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045716475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045716483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045716483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045716483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:17.886975 run osmo-stp_10.42.42.5(pid=29473): stdout: | (launched: 2022-12-10_04:57:16.103966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:18.007311 run osmo-stp_10.42.42.5(pid=29473): stderr: | 20221210045716472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045716472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045716472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045716475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045716483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045716483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045716483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:18.151345 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29473): Process ended prematurely: osmo-stp_10.42.42.5(pid=29473) [trial-2369↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29473)] [trial-2369↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 04:57:18.159746 tst handover.py:18: Test FAILED (6.7 sec) 04:57:18.186047 run osmo-hlr_10.42.42.2(pid=29470): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29470)] 04:57:18.233639 run osmo-hlr_10.42.42.2(pid=29470): stdout: | (launched: 2022-12-10_04:57:15.092595) 04:57:18.282937 run osmo-hlr_10.42.42.2(pid=29470): stderr: | 20221210045715291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045715292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045715292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045715292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045715292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045715292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045715304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045715312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045715312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045715312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:18.351629 run osmo-msc_10.42.42.6(pid=29476): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29476)] 04:57:18.399141 run osmo-msc_10.42.42.6(pid=29476): stdout: | (launched: 2022-12-10_04:57:17.271431) 04:57:18.447764 run osmo-msc_10.42.42.6(pid=29476): stderr: | 20221210045717540 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045717540 DLGLOBAL DEBUG validating counter group 0x7fda65fd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045717540 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045717540 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045717540 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045717541 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045717542 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045717543 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045717543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045717543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:18.497224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29469): Terminating (SIGTERM) 04:57:18.537340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29472): Terminating (SIGTERM) 04:57:18.577141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29475): Terminating (SIGTERM) 04:57:18.617196 --- ParallelTerminationStrategy: PID 29469 died... 04:57:18.636075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29469): Terminated: ok {rc=0} 04:57:18.680555 --- ParallelTerminationStrategy: PID 29472 died... 04:57:18.699198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29472): Terminated: ok {rc=0} 04:57:18.743846 --- ParallelTerminationStrategy: PID 29475 died... 04:57:18.762413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29475): Terminated: ok {rc=0} 04:57:18.847706 bus /sierra_3: Setting Powered False 04:57:19.947623 bus /sierra_3: Setting Powered False 04:57:21.064031 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 04:57:22.322805 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:22.328448 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:57:22.394569 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:57:22.422196 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:57:22.475680 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:57:22.543922 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:57:22.571659 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:57:23.121805 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 04:57:23.127057 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:23.138510 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:23.189723 tst handover.py: using LAC 26164 04:57:23.318567 tst handover.py: using RAC 154 04:57:23.446788 tst handover.py: using CellId 26164 04:57:23.574492 tst handover.py: using BVCI 26165 04:57:23.691809 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:23.741386 tst handover.py: using LAC 26165 04:57:23.868854 tst handover.py: using RAC 155 04:57:23.997015 tst handover.py: using CellId 26165 04:57:24.123823 tst handover.py: using BVCI 26166 04:57:24.242849 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:24.254397 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:24.265756 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:24.277658 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:24.289466 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:24.301322 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:24.416427 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:24.531766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:25.005221 run create_hlr_db(pid=29481): Launched 04:57:25.131680 bus /sierra_2: Setting Powered False 04:57:26.195508 run create_hlr_db(pid=29481): Terminated: ok {rc=0} 04:57:26.617181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29483): Launched 04:57:26.939458 run osmo-hlr_10.42.42.2(pid=29484): Launched 04:57:27.063496 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:27.591305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29486): Launched 04:57:27.913596 run osmo-stp_10.42.42.5(pid=29487): Launched 04:57:28.037112 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:28.595110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29489): Launched 04:57:28.917920 run osmo-msc_10.42.42.6(pid=29490): Launched 04:57:29.097934 run osmo-stp_10.42.42.5(pid=29487): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29487)] 04:57:29.233550 run osmo-stp_10.42.42.5(pid=29487): stdout: | (launched: 2022-12-10_04:57:27.854486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:29.369991 run osmo-stp_10.42.42.5(pid=29487): stderr: | 20221210045728045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045728045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045728045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045728046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045728046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045728046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045728046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:29.505060 run osmo-stp_10.42.42.5(pid=29487): stdout: | (launched: 2022-12-10_04:57:27.854486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:29.633573 run osmo-stp_10.42.42.5(pid=29487): stderr: | 20221210045728045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045728045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045728045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045728046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045728046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045728046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045728046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:29.787036 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29487): Process ended prematurely: osmo-stp_10.42.42.5(pid=29487) [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29487)] [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 04:57:29.795890 tst handover.py:18: Test FAILED (6.7 sec) 04:57:29.823281 run osmo-hlr_10.42.42.2(pid=29484): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29484)] 04:57:29.872690 run osmo-hlr_10.42.42.2(pid=29484): stdout: | (launched: 2022-12-10_04:57:26.880594) 04:57:29.923535 run osmo-hlr_10.42.42.2(pid=29484): stderr: | 20221210045727080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045727080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045727080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045727080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045727080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045727080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045727092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045727100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045727100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045727100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:29.994639 run osmo-msc_10.42.42.6(pid=29490): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29490)] 04:57:30.043872 run osmo-msc_10.42.42.6(pid=29490): stdout: | (launched: 2022-12-10_04:57:28.858798) 04:57:30.094797 run osmo-msc_10.42.42.6(pid=29490): stderr: | 20221210045729180 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045729180 DLGLOBAL DEBUG validating counter group 0x7ff3a4d51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045729180 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045729180 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045729180 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045729181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045729182 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045729183 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045729183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045729183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:30.146160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29483): Terminating (SIGTERM) 04:57:30.187133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29486): Terminating (SIGTERM) 04:57:30.228223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29489): Terminating (SIGTERM) 04:57:30.269455 --- ParallelTerminationStrategy: PID 29483 died... 04:57:30.288817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29483): Terminated: ok {rc=0} 04:57:30.334510 --- ParallelTerminationStrategy: PID 29486 died... 04:57:30.353825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29486): Terminated: ok {rc=0} 04:57:30.399328 --- ParallelTerminationStrategy: PID 29489 died... 04:57:30.418660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29489): Terminated: ok {rc=0} 04:57:30.506005 bus /sierra_3: Setting Powered False 04:57:31.601443 bus /sierra_3: Setting Powered False 04:57:32.717515 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 04:57:33.985484 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:33.990690 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:57:34.054524 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:57:34.082049 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:57:34.134456 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:57:34.197994 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:57:34.225103 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:57:34.774658 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 04:57:34.779740 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:34.790793 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:34.839187 tst handover.py: using LAC 26166 04:57:34.959065 tst handover.py: using RAC 156 04:57:35.076740 tst handover.py: using CellId 26166 04:57:35.195326 tst handover.py: using BVCI 26167 04:57:35.306838 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:35.354094 tst handover.py: using LAC 26167 04:57:35.474144 tst handover.py: using RAC 157 04:57:35.596751 tst handover.py: using CellId 26167 04:57:35.738482 tst handover.py: using BVCI 26168 04:57:35.857923 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:35.869623 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:35.881155 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:35.893798 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:35.905823 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:35.917899 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:36.039986 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:36.161898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:36.635997 run create_hlr_db(pid=29495): Launched 04:57:36.767306 bus /sierra_2: Setting Powered False 04:57:37.831455 run create_hlr_db(pid=29495): Terminated: ok {rc=0} 04:57:38.237856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29497): Launched 04:57:38.541950 run osmo-hlr_10.42.42.2(pid=29498): Launched 04:57:38.658694 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:39.155727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29500): Launched 04:57:39.458831 run osmo-stp_10.42.42.5(pid=29501): Launched 04:57:39.575653 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:40.099522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29503): Launched 04:57:40.402608 run osmo-msc_10.42.42.6(pid=29504): Launched 04:57:40.572680 run osmo-stp_10.42.42.5(pid=29501): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29501)] 04:57:40.701477 run osmo-stp_10.42.42.5(pid=29501): stdout: | (launched: 2022-12-10_04:57:39.402753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:40.829752 run osmo-stp_10.42.42.5(pid=29501): stderr: | 20221210045739572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045739572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045739572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045739573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045739573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045739573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045739573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:40.955993 run osmo-stp_10.42.42.5(pid=29501): stdout: | (launched: 2022-12-10_04:57:39.402753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:41.076632 run osmo-stp_10.42.42.5(pid=29501): stderr: | 20221210045739572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045739572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045739572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045739573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045739573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045739573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045739573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:41.221424 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29501): Process ended prematurely: osmo-stp_10.42.42.5(pid=29501) [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29501)] [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 04:57:41.229784 tst handover.py:18: Test FAILED (6.4 sec) 04:57:41.256221 run osmo-hlr_10.42.42.2(pid=29498): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29498)] 04:57:41.303805 run osmo-hlr_10.42.42.2(pid=29498): stdout: | (launched: 2022-12-10_04:57:38.486165) 04:57:41.352919 run osmo-hlr_10.42.42.2(pid=29498): stderr: | 20221210045738666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045738666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045738666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045738666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045738666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045738666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045738679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045738689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045738689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045738689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:41.421988 run osmo-msc_10.42.42.6(pid=29504): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29504)] 04:57:41.469309 run osmo-msc_10.42.42.6(pid=29504): stdout: | (launched: 2022-12-10_04:57:40.347153) 04:57:41.518153 run osmo-msc_10.42.42.6(pid=29504): stderr: | 20221210045740619 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045740619 DLGLOBAL DEBUG validating counter group 0x7f55c1daac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045740619 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045740619 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045740619 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045740619 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045740621 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045740622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045740622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045740622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:41.567851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29497): Terminating (SIGTERM) 04:57:41.607421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29500): Terminating (SIGTERM) 04:57:41.646764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29503): Terminating (SIGTERM) 04:57:41.686312 --- ParallelTerminationStrategy: PID 29497 died... 04:57:41.705243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29497): Terminated: ok {rc=0} 04:57:41.749433 --- ParallelTerminationStrategy: PID 29500 died... 04:57:41.767812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29500): Terminated: ok {rc=0} 04:57:41.811949 --- ParallelTerminationStrategy: PID 29503 died... 04:57:41.830543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29503): Terminated: ok {rc=0} 04:57:41.916037 bus /sierra_3: Setting Powered False 04:57:43.015297 bus /sierra_3: Setting Powered False 04:57:44.127703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 04:57:45.399425 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:45.405396 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:57:45.456742 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:57:45.484422 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:57:45.538882 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:57:45.590706 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:57:45.618052 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:57:46.170370 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 04:57:46.176809 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:46.189175 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:46.225364 tst handover.py: using LAC 26168 04:57:46.359102 tst handover.py: using RAC 158 04:57:46.488462 tst handover.py: using CellId 26168 04:57:46.617033 tst handover.py: using BVCI 26169 04:57:46.738063 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:46.788225 tst handover.py: using LAC 26169 04:57:46.917319 tst handover.py: using RAC 159 04:57:47.049111 tst handover.py: using CellId 26169 04:57:47.177184 tst handover.py: using BVCI 26170 04:57:47.289516 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.300700 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.311629 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.322580 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.333725 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:47.344877 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:47.463391 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:47.581378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:48.054785 run create_hlr_db(pid=29509): Launched 04:57:48.186682 bus /sierra_2: Setting Powered False 04:57:49.250616 run create_hlr_db(pid=29509): Terminated: ok {rc=0} 04:57:49.658611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29511): Launched 04:57:49.962381 run osmo-hlr_10.42.42.2(pid=29512): Launched 04:57:50.077988 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:50.574008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29514): Launched 04:57:50.877937 run osmo-stp_10.42.42.5(pid=29515): Launched 04:57:50.994171 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:51.517123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29517): Launched 04:57:51.820424 run osmo-msc_10.42.42.6(pid=29518): Launched 04:57:52.037948 run osmo-stp_10.42.42.5(pid=29515): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29515)] 04:57:52.167466 run osmo-stp_10.42.42.5(pid=29515): stdout: | (launched: 2022-12-10_04:57:50.822390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:52.295698 run osmo-stp_10.42.42.5(pid=29515): stderr: | 20221210045750990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045750990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045750991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045750991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045750993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045750993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045750993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:52.421926 run osmo-stp_10.42.42.5(pid=29515): stdout: | (launched: 2022-12-10_04:57:50.822390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:52.542594 run osmo-stp_10.42.42.5(pid=29515): stderr: | 20221210045750990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045750990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045750991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045750991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045750993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045750993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045750993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:52.687693 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29515): Process ended prematurely: osmo-stp_10.42.42.5(pid=29515) [trial-2369↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29515)] [trial-2369↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 04:57:52.696300 tst handover.py:18: Test FAILED (6.5 sec) 04:57:52.723011 run osmo-hlr_10.42.42.2(pid=29512): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29512)] 04:57:52.771713 run osmo-hlr_10.42.42.2(pid=29512): stdout: | (launched: 2022-12-10_04:57:49.906750) 04:57:52.821525 run osmo-hlr_10.42.42.2(pid=29512): stderr: | 20221210045750081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045750082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045750082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045750082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045750082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045750082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045750094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045750103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045750103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045750103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:52.890919 run osmo-msc_10.42.42.6(pid=29518): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29518)] 04:57:52.938773 run osmo-msc_10.42.42.6(pid=29518): stdout: | (launched: 2022-12-10_04:57:51.764801) 04:57:52.988256 run osmo-msc_10.42.42.6(pid=29518): stderr: | 20221210045752063 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045752063 DLGLOBAL DEBUG validating counter group 0x7f51d6e8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045752064 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045752064 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045752064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045752064 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045752066 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045752066 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045752066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045752066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:53.038368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29511): Terminating (SIGTERM) 04:57:53.078261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29514): Terminating (SIGTERM) 04:57:53.118294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29517): Terminating (SIGTERM) 04:57:53.158413 --- ParallelTerminationStrategy: PID 29511 died... 04:57:53.177398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29511): Terminated: ok {rc=0} 04:57:53.222058 --- ParallelTerminationStrategy: PID 29514 died... 04:57:53.240926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29514): Terminated: ok {rc=0} 04:57:53.285406 --- ParallelTerminationStrategy: PID 29517 died... 04:57:53.304142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29517): Terminated: ok {rc=0} 04:57:53.390229 bus /sierra_3: Setting Powered False 04:57:54.488802 bus /sierra_3: Setting Powered False 04:57:55.603972 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 04:57:56.861428 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:56.866590 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:57:56.917402 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:57:56.944471 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:57:56.996735 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:57:57.047852 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:57:57.075661 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:57:57.622830 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 04:57:57.628817 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:57.640058 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:57.675941 tst handover.py: using LAC 26170 04:57:57.793441 tst handover.py: using RAC 160 04:57:57.920594 tst handover.py: using CellId 26170 04:57:58.045698 tst handover.py: using BVCI 26171 04:57:58.156792 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:58.203400 tst handover.py: using LAC 26171 04:57:58.321442 tst handover.py: using RAC 161 04:57:58.452869 tst handover.py: using CellId 26171 04:57:58.579106 tst handover.py: using BVCI 26172 04:57:58.698179 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:58.709691 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:58.720892 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:58.732134 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:58.743444 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:58.754614 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:58.869687 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:58.985941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:59.461361 run create_hlr_db(pid=29523): Launched 04:57:59.591872 bus /sierra_2: Setting Powered False 04:58:00.656646 run create_hlr_db(pid=29523): Terminated: ok {rc=0} 04:58:01.081780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29525): Launched 04:58:01.401787 run osmo-hlr_10.42.42.2(pid=29526): Launched 04:58:01.645311 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:02.322181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29528): Launched 04:58:02.652283 run osmo-stp_10.42.42.5(pid=29529): Launched 04:58:02.770710 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:03.299465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29531): Launched 04:58:03.603577 run osmo-msc_10.42.42.6(pid=29532): Launched 04:58:03.774402 run osmo-stp_10.42.42.5(pid=29529): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29529)] 04:58:03.903577 run osmo-stp_10.42.42.5(pid=29529): stdout: | (launched: 2022-12-10_04:58:02.593282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:04.032763 run osmo-stp_10.42.42.5(pid=29529): stderr: | 20221210045802766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045802766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045802766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045802766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045802767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045802767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045802767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:04.159357 run osmo-stp_10.42.42.5(pid=29529): stdout: | (launched: 2022-12-10_04:58:02.593282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:04.280511 run osmo-stp_10.42.42.5(pid=29529): stderr: | 20221210045802766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045802766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045802766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045802766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045802767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045802767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045802767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:04.425581 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29529): Process ended prematurely: osmo-stp_10.42.42.5(pid=29529) [trial-2369↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29529)] [trial-2369↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 04:58:04.433868 tst handover.py:18: Test FAILED (6.8 sec) 04:58:04.461420 run osmo-hlr_10.42.42.2(pid=29526): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29526)] 04:58:04.509310 run osmo-hlr_10.42.42.2(pid=29526): stdout: | (launched: 2022-12-10_04:58:01.340897) 04:58:04.558857 run osmo-hlr_10.42.42.2(pid=29526): stderr: | 20221210045801545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045801545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045801545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045801546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045801546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045801546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045801566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045801586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045801586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045801586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:04.628057 run osmo-msc_10.42.42.6(pid=29532): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29532)] 04:58:04.675759 run osmo-msc_10.42.42.6(pid=29532): stdout: | (launched: 2022-12-10_04:58:03.547835) 04:58:04.725627 run osmo-msc_10.42.42.6(pid=29532): stderr: | 20221210045803820 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045803820 DLGLOBAL DEBUG validating counter group 0x7f89d7266c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045803820 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045803820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045803821 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045803821 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045803823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045803823 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045803823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045803823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:04.775541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29525): Terminating (SIGTERM) 04:58:04.815228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29528): Terminating (SIGTERM) 04:58:04.854933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29531): Terminating (SIGTERM) 04:58:04.894978 --- ParallelTerminationStrategy: PID 29525 died... 04:58:04.914056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29525): Terminated: ok {rc=0} 04:58:04.958791 --- ParallelTerminationStrategy: PID 29528 died... 04:58:04.977443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29528): Terminated: ok {rc=0} 04:58:05.022103 --- ParallelTerminationStrategy: PID 29531 died... 04:58:05.040741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29531): Terminated: ok {rc=0} 04:58:05.127245 bus /sierra_3: Setting Powered False 04:58:06.226245 bus /sierra_3: Setting Powered False 04:58:07.340781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2369 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 04:58:08.598759 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:08.604218 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:58:08.667777 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:58:08.695411 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:58:08.749564 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:58:08.815548 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:58:08.842948 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:58:09.391718 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2369 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 04:58:09.397126 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:09.408404 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:09.457145 tst handover.py: using LAC 26172 04:58:09.577104 tst handover.py: using RAC 162 04:58:09.697331 tst handover.py: using CellId 26172 04:58:09.816197 tst handover.py: using BVCI 26173 04:58:09.926179 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:09.973340 tst handover.py: using LAC 26173 04:58:10.094021 tst handover.py: using RAC 163 04:58:10.222491 tst handover.py: using CellId 26173 04:58:10.350728 tst handover.py: using BVCI 26174 04:58:10.469582 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:10.481084 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:10.492460 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:10.504353 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:10.516454 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:10.528381 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:10.649316 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:10.766679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:11.210700 run create_hlr_db(pid=29537): Launched 04:58:11.327474 bus /sierra_2: Setting Powered False 04:58:12.387874 run create_hlr_db(pid=29537): Terminated: ok {rc=0} 04:58:12.801650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29539): Launched 04:58:13.126926 run osmo-hlr_10.42.42.2(pid=29540): Launched 04:58:13.250777 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:13.782244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29542): Launched 04:58:14.106659 run osmo-stp_10.42.42.5(pid=29543): Launched 04:58:14.229975 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:14.787495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29545): Launched 04:58:15.112833 run osmo-msc_10.42.42.6(pid=29546): Launched 04:58:15.293200 run osmo-stp_10.42.42.5(pid=29543): ERR: Terminated: ERROR {rc=1} [trial-2369↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29543)] 04:58:15.429989 run osmo-stp_10.42.42.5(pid=29543): stdout: | (launched: 2022-12-10_04:58:14.046498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:15.566604 run osmo-stp_10.42.42.5(pid=29543): stderr: | 20221210045814238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045814239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045814239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045814239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045814240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045814240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045814240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:15.702063 run osmo-stp_10.42.42.5(pid=29543): stdout: | (launched: 2022-12-10_04:58:14.046498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:15.830944 run osmo-stp_10.42.42.5(pid=29543): stderr: | 20221210045814238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210045814239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210045814239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210045814239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210045814240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210045814240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210045814240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:16.010429 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=29543): Process ended prematurely: osmo-stp_10.42.42.5(pid=29543) [trial-2369↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29543)] [trial-2369↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 04:58:16.020014 tst handover.py:18: Test FAILED (6.6 sec) 04:58:16.050128 run osmo-hlr_10.42.42.2(pid=29540): ERR: Terminated: ERROR {rc=237} [trial-2369↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29540)] 04:58:16.103301 run osmo-hlr_10.42.42.2(pid=29540): stdout: | (launched: 2022-12-10_04:58:13.066913) 04:58:16.155806 run osmo-hlr_10.42.42.2(pid=29540): stderr: | 20221210045813265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210045813265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210045813265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210045813265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210045813265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210045813265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210045813278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210045813286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210045813286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210045813286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:16.227868 run osmo-msc_10.42.42.6(pid=29546): ERR: Terminated: ERROR {rc=2} [trial-2369↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29546)] 04:58:16.279430 run osmo-msc_10.42.42.6(pid=29546): stdout: | (launched: 2022-12-10_04:58:15.053124) 04:58:16.331704 run osmo-msc_10.42.42.6(pid=29546): stderr: | 20221210045815373 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210045815373 DLGLOBAL DEBUG validating counter group 0x7fbfbaeedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210045815373 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210045815373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210045815373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210045815373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210045815375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210045815375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210045815376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210045815376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:16.385130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29539): Terminating (SIGTERM) 04:58:16.428468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29542): Terminating (SIGTERM) 04:58:16.474367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29545): Terminating (SIGTERM) 04:58:16.519170 --- ParallelTerminationStrategy: PID 29539 died... 04:58:16.539499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29539): Terminated: ok {rc=0} 04:58:16.589306 --- ParallelTerminationStrategy: PID 29542 died... 04:58:16.609334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29542): Terminated: ok {rc=0} 04:58:16.657757 --- ParallelTerminationStrategy: PID 29545 died... 04:58:16.677844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29545): Terminated: ok {rc=0} 04:58:16.764518 bus /sierra_3: Setting Powered False 04:58:17.861348 bus /sierra_3: Setting Powered False 04:58:18.976290 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2369 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 04:58:20.244675 tst trial-2369: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369/run.2022-12-10_03-34-39/trial-2369.xml -------------------------------------------------------------------------------------------- trial-2369 FAIL -------------------------------------------------------------------------------------------- 04:58:22.164502 tst trial-2369: trial-2369: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=21123): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21123) [trial-2369↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21123)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (13.9 sec) Error: osmo-stp_10.42.42.5(pid=21135): Process ended prematurely: osmo-stp_10.42.42.5(pid=21135) [trial-2369↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21135)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=21144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21144) [trial-2369↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21144)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=21155): Process ended prematurely: osmo-stp_10.42.42.5(pid=21155) [trial-2369↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21155)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21170): Process ended prematurely: osmo-stp_10.42.42.5(pid=21170) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21170)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21181): Process ended prematurely: osmo-stp_10.42.42.5(pid=21181) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21181)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21195): Process ended prematurely: osmo-stp_10.42.42.5(pid=21195) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21195)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21206): Process ended prematurely: osmo-stp_10.42.42.5(pid=21206) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21206)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21221): Process ended prematurely: osmo-stp_10.42.42.5(pid=21221) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21221)] FAIL: mo_mt_call_osmux.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=21503): Process ended prematurely: osmo-stp_10.42.42.5(pid=21503) [trial-2369↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21503)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21517): Process ended prematurely: osmo-stp_10.42.42.5(pid=21517) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21517)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21529): Process ended prematurely: osmo-stp_10.42.42.5(pid=21529) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21529)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21543): Process ended prematurely: osmo-stp_10.42.42.5(pid=21543) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21543)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21554): Process ended prematurely: osmo-stp_10.42.42.5(pid=21554) [trial-2369↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21554)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21568): Process ended prematurely: osmo-stp_10.42.42.5(pid=21568) [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21568)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21579): Process ended prematurely: osmo-stp_10.42.42.5(pid=21579) [trial-2369↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21579)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=21593): Process ended prematurely: osmo-stp_10.42.42.5(pid=21593) [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21593)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21604): Process ended prematurely: osmo-stp_10.42.42.5(pid=21604) [trial-2369↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21604)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21625): Process ended prematurely: osmo-stp_10.42.42.5(pid=21625) [trial-2369↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21625)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21640): Process ended prematurely: osmo-stp_10.42.42.5(pid=21640) [trial-2369↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21640)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=22184): Process ended prematurely: osmo-stp_10.42.42.5(pid=22184) [trial-2369↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22184)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22196): Process ended prematurely: osmo-stp_10.42.42.5(pid=22196) [trial-2369↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22196)] FAIL: iperf3m4.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=22214): Process ended prematurely: osmo-stp_10.42.42.5(pid=22214) [trial-2369↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22214)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22224): Process ended prematurely: osmo-stp_10.42.42.5(pid=22224) [trial-2369↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22224)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22234): Process ended prematurely: osmo-stp_10.42.42.5(pid=22234) [trial-2369↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22234)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22251): Process ended prematurely: osmo-stp_10.42.42.5(pid=22251) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22251)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22265): Process ended prematurely: osmo-stp_10.42.42.5(pid=22265) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22265)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=22283): Process ended prematurely: osmo-stp_10.42.42.5(pid=22283) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22283)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22296): Process ended prematurely: osmo-stp_10.42.42.5(pid=22296) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22296)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22306): Process ended prematurely: osmo-stp_10.42.42.5(pid=22306) [trial-2369↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22306)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=22323): Process ended prematurely: osmo-stp_10.42.42.5(pid=22323) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22323)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22336): Process ended prematurely: osmo-stp_10.42.42.5(pid=22336) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22336)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22354): Process ended prematurely: osmo-stp_10.42.42.5(pid=22354) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22354)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22364): Process ended prematurely: osmo-stp_10.42.42.5(pid=22364) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22364)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22374): Process ended prematurely: osmo-stp_10.42.42.5(pid=22374) [trial-2369↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22374)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22391): Process ended prematurely: osmo-stp_10.42.42.5(pid=22391) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22391)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22403): Process ended prematurely: osmo-stp_10.42.42.5(pid=22403) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22403)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=22421): Process ended prematurely: osmo-stp_10.42.42.5(pid=22421) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22421)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22432): Process ended prematurely: osmo-stp_10.42.42.5(pid=22432) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22432)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22442): Process ended prematurely: osmo-stp_10.42.42.5(pid=22442) [trial-2369↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22442)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22456): Process ended prematurely: osmo-stp_10.42.42.5(pid=22456) [trial-2369↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22456)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22470): Process ended prematurely: osmo-stp_10.42.42.5(pid=22470) [trial-2369↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22479): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22479) [trial-2369↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22479)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=22489): Process ended prematurely: osmo-stp_10.42.42.5(pid=22489) [trial-2369↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22489)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22501): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22501) [trial-2369↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22501)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=22511): Process ended prematurely: osmo-stp_10.42.42.5(pid=22511) [trial-2369↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22511)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22525): Process ended prematurely: osmo-stp_10.42.42.5(pid=22525) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22525)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22536): Process ended prematurely: osmo-stp_10.42.42.5(pid=22536) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22536)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22550): Process ended prematurely: osmo-stp_10.42.42.5(pid=22550) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22550)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22561): Process ended prematurely: osmo-stp_10.42.42.5(pid=22561) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22561)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22575): Process ended prematurely: osmo-stp_10.42.42.5(pid=22575) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22575)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22586): Process ended prematurely: osmo-stp_10.42.42.5(pid=22586) [trial-2369↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22586)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22600): Process ended prematurely: osmo-stp_10.42.42.5(pid=22600) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22600)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22611): Process ended prematurely: osmo-stp_10.42.42.5(pid=22611) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=22626): Process ended prematurely: osmo-stp_10.42.42.5(pid=22626) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22626)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22637): Process ended prematurely: osmo-stp_10.42.42.5(pid=22637) [trial-2369↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22637)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22651): Process ended prematurely: osmo-stp_10.42.42.5(pid=22651) [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22651)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22662): Process ended prematurely: osmo-stp_10.42.42.5(pid=22662) [trial-2369↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22662)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=22676): Process ended prematurely: osmo-stp_10.42.42.5(pid=22676) [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22676)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22687): Process ended prematurely: osmo-stp_10.42.42.5(pid=22687) [trial-2369↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22687)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22701): Process ended prematurely: osmo-stp_10.42.42.5(pid=22701) [trial-2369↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22701)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22712): Process ended prematurely: osmo-stp_10.42.42.5(pid=22712) [trial-2369↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22712)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22731): Process ended prematurely: osmo-stp_10.42.42.5(pid=22731) [trial-2369↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22731)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22744): Process ended prematurely: osmo-stp_10.42.42.5(pid=22744) [trial-2369↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22744)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=22762): Process ended prematurely: osmo-stp_10.42.42.5(pid=22762) [trial-2369↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22762)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22772): Process ended prematurely: osmo-stp_10.42.42.5(pid=22772) [trial-2369↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22772)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22782): Process ended prematurely: osmo-stp_10.42.42.5(pid=22782) [trial-2369↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22782)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=22800): Process ended prematurely: osmo-stp_10.42.42.5(pid=22800) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22800)] FAIL: iperf3.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=22813): Process ended prematurely: osmo-stp_10.42.42.5(pid=22813) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22813)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=22831): Process ended prematurely: osmo-stp_10.42.42.5(pid=22831) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22831)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22841): Process ended prematurely: osmo-stp_10.42.42.5(pid=22841) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22841)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22851): Process ended prematurely: osmo-stp_10.42.42.5(pid=22851) [trial-2369↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22851)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=22872): Process ended prematurely: osmo-stp_10.42.42.5(pid=22872) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22872)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22884): Process ended prematurely: osmo-stp_10.42.42.5(pid=22884) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22884)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=22902): Process ended prematurely: osmo-stp_10.42.42.5(pid=22902) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22902)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22912): Process ended prematurely: osmo-stp_10.42.42.5(pid=22912) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22912)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22922): Process ended prematurely: osmo-stp_10.42.42.5(pid=22922) [trial-2369↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22922)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=22940): Process ended prematurely: osmo-stp_10.42.42.5(pid=22940) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22940)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22952): Process ended prematurely: osmo-stp_10.42.42.5(pid=22952) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22952)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=22970): Process ended prematurely: osmo-stp_10.42.42.5(pid=22970) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22970)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22980): Process ended prematurely: osmo-stp_10.42.42.5(pid=22980) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22980)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22990): Process ended prematurely: osmo-stp_10.42.42.5(pid=22990) [trial-2369↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22990)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23004): Process ended prematurely: osmo-stp_10.42.42.5(pid=23004) [trial-2369↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23004)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23017): Process ended prematurely: osmo-stp_10.42.42.5(pid=23017) [trial-2369↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23017)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23025): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23025) [trial-2369↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23025)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=23035): Process ended prematurely: osmo-stp_10.42.42.5(pid=23035) [trial-2369↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23044): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23044) [trial-2369↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=23054): Process ended prematurely: osmo-stp_10.42.42.5(pid=23054) [trial-2369↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23054)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23068): Process ended prematurely: osmo-stp_10.42.42.5(pid=23068) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23068)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23079): Process ended prematurely: osmo-stp_10.42.42.5(pid=23079) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23079)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=23364): Process ended prematurely: osmo-stp_10.42.42.5(pid=23364) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23364)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23375): Process ended prematurely: osmo-stp_10.42.42.5(pid=23375) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23375)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23389): Process ended prematurely: osmo-stp_10.42.42.5(pid=23389) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23389)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23400): Process ended prematurely: osmo-stp_10.42.42.5(pid=23400) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23400)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23415): Process ended prematurely: osmo-stp_10.42.42.5(pid=23415) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23415)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23426): Process ended prematurely: osmo-stp_10.42.42.5(pid=23426) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23426)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23442): Process ended prematurely: osmo-stp_10.42.42.5(pid=23442) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23442)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23453): Process ended prematurely: osmo-stp_10.42.42.5(pid=23453) [trial-2369↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23453)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23467): Process ended prematurely: osmo-stp_10.42.42.5(pid=23467) [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23467)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23481): Process ended prematurely: osmo-stp_10.42.42.5(pid=23481) [trial-2369↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23481)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23496): Process ended prematurely: osmo-stp_10.42.42.5(pid=23496) [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23496)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23507): Process ended prematurely: osmo-stp_10.42.42.5(pid=23507) [trial-2369↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23507)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23522): Process ended prematurely: osmo-stp_10.42.42.5(pid=23522) [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23522)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23533): Process ended prematurely: osmo-stp_10.42.42.5(pid=23533) [trial-2369↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23533)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23547): Process ended prematurely: osmo-stp_10.42.42.5(pid=23547) [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23547)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23558): Process ended prematurely: osmo-stp_10.42.42.5(pid=23558) [trial-2369↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23558)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23572): Process ended prematurely: osmo-stp_10.42.42.5(pid=23572) [trial-2369↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23572)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23583): Process ended prematurely: osmo-stp_10.42.42.5(pid=23583) [trial-2369↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23583)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=23601): Process ended prematurely: osmo-stp_10.42.42.5(pid=23601) [trial-2369↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23601)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23613): Process ended prematurely: osmo-stp_10.42.42.5(pid=23613) [trial-2369↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23631): Process ended prematurely: osmo-stp_10.42.42.5(pid=23631) [trial-2369↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23631)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23641): Process ended prematurely: osmo-stp_10.42.42.5(pid=23641) [trial-2369↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23641)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23651): Process ended prematurely: osmo-stp_10.42.42.5(pid=23651) [trial-2369↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23651)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=23669): Process ended prematurely: osmo-stp_10.42.42.5(pid=23669) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23669)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23681): Process ended prematurely: osmo-stp_10.42.42.5(pid=23681) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23681)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23699): Process ended prematurely: osmo-stp_10.42.42.5(pid=23699) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23699)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23709): Process ended prematurely: osmo-stp_10.42.42.5(pid=23709) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23709)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23719): Process ended prematurely: osmo-stp_10.42.42.5(pid=23719) [trial-2369↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23719)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=23736): Process ended prematurely: osmo-stp_10.42.42.5(pid=23736) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23736)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=23748): Process ended prematurely: osmo-stp_10.42.42.5(pid=23748) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23748)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23766): Process ended prematurely: osmo-stp_10.42.42.5(pid=23766) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23766)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23776): Process ended prematurely: osmo-stp_10.42.42.5(pid=23776) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23776)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23786): Process ended prematurely: osmo-stp_10.42.42.5(pid=23786) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23786)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23805): Process ended prematurely: osmo-stp_10.42.42.5(pid=23805) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23805)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23817): Process ended prematurely: osmo-stp_10.42.42.5(pid=23817) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23817)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23838): Process ended prematurely: osmo-stp_10.42.42.5(pid=23838) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23838)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23848): Process ended prematurely: osmo-stp_10.42.42.5(pid=23848) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23848)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23858): Process ended prematurely: osmo-stp_10.42.42.5(pid=23858) [trial-2369↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23858)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23875): Process ended prematurely: osmo-stp_10.42.42.5(pid=23875) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23875)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23887): Process ended prematurely: osmo-stp_10.42.42.5(pid=23887) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23887)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23905): Process ended prematurely: osmo-stp_10.42.42.5(pid=23905) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23905)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23915): Process ended prematurely: osmo-stp_10.42.42.5(pid=23915) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23915)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23925): Process ended prematurely: osmo-stp_10.42.42.5(pid=23925) [trial-2369↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23925)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23938): Process ended prematurely: osmo-stp_10.42.42.5(pid=23938) [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23938)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23965): Process ended prematurely: osmo-stp_10.42.42.5(pid=23965) [trial-2369↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23965)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=23973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23973) [trial-2369↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23973)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23983): Process ended prematurely: osmo-stp_10.42.42.5(pid=23983) [trial-2369↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23983)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=23992): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23992) [trial-2369↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23992)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24002): Process ended prematurely: osmo-stp_10.42.42.5(pid=24002) [trial-2369↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24002)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24016): Process ended prematurely: osmo-stp_10.42.42.5(pid=24016) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24016)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24027): Process ended prematurely: osmo-stp_10.42.42.5(pid=24027) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24027)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24041): Process ended prematurely: osmo-stp_10.42.42.5(pid=24041) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24041)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24053): Process ended prematurely: osmo-stp_10.42.42.5(pid=24053) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24053)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24067): Process ended prematurely: osmo-stp_10.42.42.5(pid=24067) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24067)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24078): Process ended prematurely: osmo-stp_10.42.42.5(pid=24078) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24078)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24092): Process ended prematurely: osmo-stp_10.42.42.5(pid=24092) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24092)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24103): Process ended prematurely: osmo-stp_10.42.42.5(pid=24103) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24103)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24117): Process ended prematurely: osmo-stp_10.42.42.5(pid=24117) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24128): Process ended prematurely: osmo-stp_10.42.42.5(pid=24128) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24128)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24142): Process ended prematurely: osmo-stp_10.42.42.5(pid=24142) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24142)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24154): Process ended prematurely: osmo-stp_10.42.42.5(pid=24154) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24154)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24168): Process ended prematurely: osmo-stp_10.42.42.5(pid=24168) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24180): Process ended prematurely: osmo-stp_10.42.42.5(pid=24180) [trial-2369↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24180)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24197): Process ended prematurely: osmo-stp_10.42.42.5(pid=24197) [trial-2369↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24197)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24208): Process ended prematurely: osmo-stp_10.42.42.5(pid=24208) [trial-2369↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24208)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24226): Process ended prematurely: osmo-stp_10.42.42.5(pid=24226) [trial-2369↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24226)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24238): Process ended prematurely: osmo-stp_10.42.42.5(pid=24238) [trial-2369↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24238)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=24256): Process ended prematurely: osmo-stp_10.42.42.5(pid=24256) [trial-2369↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24256)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24266): Process ended prematurely: osmo-stp_10.42.42.5(pid=24266) [trial-2369↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24266)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24276): Process ended prematurely: osmo-stp_10.42.42.5(pid=24276) [trial-2369↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24276)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24293): Process ended prematurely: osmo-stp_10.42.42.5(pid=24293) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24293)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24305): Process ended prematurely: osmo-stp_10.42.42.5(pid=24305) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24305)] FAIL: iperf3m4.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=24323): Process ended prematurely: osmo-stp_10.42.42.5(pid=24323) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24323)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24335): Process ended prematurely: osmo-stp_10.42.42.5(pid=24335) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24335)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24345): Process ended prematurely: osmo-stp_10.42.42.5(pid=24345) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=24362): Process ended prematurely: osmo-stp_10.42.42.5(pid=24362) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24362)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24377): Process ended prematurely: osmo-stp_10.42.42.5(pid=24377) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24377)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=24395): Process ended prematurely: osmo-stp_10.42.42.5(pid=24395) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24395)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24405): Process ended prematurely: osmo-stp_10.42.42.5(pid=24405) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24405)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=24687): Process ended prematurely: osmo-stp_10.42.42.5(pid=24687) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24687)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=24704): Process ended prematurely: osmo-stp_10.42.42.5(pid=24704) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24704)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=24717): Process ended prematurely: osmo-stp_10.42.42.5(pid=24717) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24717)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=24735): Process ended prematurely: osmo-stp_10.42.42.5(pid=24735) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24735)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24745): Process ended prematurely: osmo-stp_10.42.42.5(pid=24745) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24745)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24756): Process ended prematurely: osmo-stp_10.42.42.5(pid=24756) [trial-2369↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24756)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24769): Process ended prematurely: osmo-stp_10.42.42.5(pid=24769) [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24769)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24782): Process ended prematurely: osmo-stp_10.42.42.5(pid=24782) [trial-2369↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24782)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24790) [trial-2369↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24790)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24803): Process ended prematurely: osmo-stp_10.42.42.5(pid=24803) [trial-2369↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24803)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=24815): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24815) [trial-2369↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24815)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=24826): Process ended prematurely: osmo-stp_10.42.42.5(pid=24826) [trial-2369↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24826)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24840): Process ended prematurely: osmo-stp_10.42.42.5(pid=24840) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24840)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24851): Process ended prematurely: osmo-stp_10.42.42.5(pid=24851) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24851)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24865): Process ended prematurely: osmo-stp_10.42.42.5(pid=24865) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24865)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24876): Process ended prematurely: osmo-stp_10.42.42.5(pid=24876) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24876)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24890): Process ended prematurely: osmo-stp_10.42.42.5(pid=24890) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24890)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24901): Process ended prematurely: osmo-stp_10.42.42.5(pid=24901) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24901)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24915): Process ended prematurely: osmo-stp_10.42.42.5(pid=24915) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24915)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24926): Process ended prematurely: osmo-stp_10.42.42.5(pid=24926) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24926)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24940): Process ended prematurely: osmo-stp_10.42.42.5(pid=24940) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24940)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24951): Process ended prematurely: osmo-stp_10.42.42.5(pid=24951) [trial-2369↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24951)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24966): Process ended prematurely: osmo-stp_10.42.42.5(pid=24966) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24966)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24977): Process ended prematurely: osmo-stp_10.42.42.5(pid=24977) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24977)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24991): Process ended prematurely: osmo-stp_10.42.42.5(pid=24991) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24991)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25003): Process ended prematurely: osmo-stp_10.42.42.5(pid=25003) [trial-2369↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25003)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25017): Process ended prematurely: osmo-stp_10.42.42.5(pid=25017) [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25017)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25028): Process ended prematurely: osmo-stp_10.42.42.5(pid=25028) [trial-2369↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25028)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25043): Process ended prematurely: osmo-stp_10.42.42.5(pid=25043) [trial-2369↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25043)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25054): Process ended prematurely: osmo-stp_10.42.42.5(pid=25054) [trial-2369↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25054)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=25073): Process ended prematurely: osmo-stp_10.42.42.5(pid=25073) [trial-2369↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25073)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25085): Process ended prematurely: osmo-stp_10.42.42.5(pid=25085) [trial-2369↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25085)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25103): Process ended prematurely: osmo-stp_10.42.42.5(pid=25103) [trial-2369↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25103)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25113): Process ended prematurely: osmo-stp_10.42.42.5(pid=25113) [trial-2369↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25113)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25123): Process ended prematurely: osmo-stp_10.42.42.5(pid=25123) [trial-2369↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25123)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=25140): Process ended prematurely: osmo-stp_10.42.42.5(pid=25140) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25152): Process ended prematurely: osmo-stp_10.42.42.5(pid=25152) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25152)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=25173): Process ended prematurely: osmo-stp_10.42.42.5(pid=25173) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25173)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25185): Process ended prematurely: osmo-stp_10.42.42.5(pid=25185) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25195): Process ended prematurely: osmo-stp_10.42.42.5(pid=25195) [trial-2369↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25195)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=25213): Process ended prematurely: osmo-stp_10.42.42.5(pid=25213) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25213)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=25225): Process ended prematurely: osmo-stp_10.42.42.5(pid=25225) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25225)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=25243): Process ended prematurely: osmo-stp_10.42.42.5(pid=25243) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25243)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25255): Process ended prematurely: osmo-stp_10.42.42.5(pid=25255) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25255)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25266): Process ended prematurely: osmo-stp_10.42.42.5(pid=25266) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25266)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=25283): Process ended prematurely: osmo-stp_10.42.42.5(pid=25283) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25283)] FAIL: iperf3.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25295): Process ended prematurely: osmo-stp_10.42.42.5(pid=25295) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25295)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=25316): Process ended prematurely: osmo-stp_10.42.42.5(pid=25316) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25326): Process ended prematurely: osmo-stp_10.42.42.5(pid=25326) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25326)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25336): Process ended prematurely: osmo-stp_10.42.42.5(pid=25336) [trial-2369↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25336)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=25360): Process ended prematurely: osmo-stp_10.42.42.5(pid=25360) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25360)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25372): Process ended prematurely: osmo-stp_10.42.42.5(pid=25372) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25372)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=25390): Process ended prematurely: osmo-stp_10.42.42.5(pid=25390) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25390)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25400): Process ended prematurely: osmo-stp_10.42.42.5(pid=25400) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25400)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25410): Process ended prematurely: osmo-stp_10.42.42.5(pid=25410) [trial-2369↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25423): Process ended prematurely: osmo-stp_10.42.42.5(pid=25423) [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25423)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25436): Process ended prematurely: osmo-stp_10.42.42.5(pid=25436) [trial-2369↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25436)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25444): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25444) [trial-2369↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25444)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25455): Process ended prematurely: osmo-stp_10.42.42.5(pid=25455) [trial-2369↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25455)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=25464): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25464) [trial-2369↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25464)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=25474): Process ended prematurely: osmo-stp_10.42.42.5(pid=25474) [trial-2369↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25474)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25488): Process ended prematurely: osmo-stp_10.42.42.5(pid=25488) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25488)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25499): Process ended prematurely: osmo-stp_10.42.42.5(pid=25499) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25499)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25513): Process ended prematurely: osmo-stp_10.42.42.5(pid=25513) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25513)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25527): Process ended prematurely: osmo-stp_10.42.42.5(pid=25527) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25527)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=25541): Process ended prematurely: osmo-stp_10.42.42.5(pid=25541) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25541)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25553): Process ended prematurely: osmo-stp_10.42.42.5(pid=25553) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25553)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25567): Process ended prematurely: osmo-stp_10.42.42.5(pid=25567) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25567)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25592): Process ended prematurely: osmo-stp_10.42.42.5(pid=25592) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25592)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25603): Process ended prematurely: osmo-stp_10.42.42.5(pid=25603) [trial-2369↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25603)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25617): Process ended prematurely: osmo-stp_10.42.42.5(pid=25617) [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25617)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25628): Process ended prematurely: osmo-stp_10.42.42.5(pid=25628) [trial-2369↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25628)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25642): Process ended prematurely: osmo-stp_10.42.42.5(pid=25642) [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25642)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25653): Process ended prematurely: osmo-stp_10.42.42.5(pid=25653) [trial-2369↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25653)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25668): Process ended prematurely: osmo-stp_10.42.42.5(pid=25668) [trial-2369↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25668)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25679): Process ended prematurely: osmo-stp_10.42.42.5(pid=25679) [trial-2369↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=25697): Process ended prematurely: osmo-stp_10.42.42.5(pid=25697) [trial-2369↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25697)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=25710): Process ended prematurely: osmo-stp_10.42.42.5(pid=25710) [trial-2369↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25710)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=25728): Process ended prematurely: osmo-stp_10.42.42.5(pid=25728) [trial-2369↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25728)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25739): Process ended prematurely: osmo-stp_10.42.42.5(pid=25739) [trial-2369↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25749): Process ended prematurely: osmo-stp_10.42.42.5(pid=25749) [trial-2369↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25749)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=26038): Process ended prematurely: osmo-stp_10.42.42.5(pid=26038) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=26051): Process ended prematurely: osmo-stp_10.42.42.5(pid=26051) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26051)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26069): Process ended prematurely: osmo-stp_10.42.42.5(pid=26069) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26069)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26079): Process ended prematurely: osmo-stp_10.42.42.5(pid=26079) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26079)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26089): Process ended prematurely: osmo-stp_10.42.42.5(pid=26089) [trial-2369↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26089)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26106): Process ended prematurely: osmo-stp_10.42.42.5(pid=26106) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26106)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26118): Process ended prematurely: osmo-stp_10.42.42.5(pid=26118) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26118)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26136): Process ended prematurely: osmo-stp_10.42.42.5(pid=26136) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26136)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26149): Process ended prematurely: osmo-stp_10.42.42.5(pid=26149) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26149)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26160): Process ended prematurely: osmo-stp_10.42.42.5(pid=26160) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26178): Process ended prematurely: osmo-stp_10.42.42.5(pid=26178) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26178)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26190): Process ended prematurely: osmo-stp_10.42.42.5(pid=26190) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26190)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26208): Process ended prematurely: osmo-stp_10.42.42.5(pid=26208) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26208)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26218): Process ended prematurely: osmo-stp_10.42.42.5(pid=26218) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26218)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26228): Process ended prematurely: osmo-stp_10.42.42.5(pid=26228) [trial-2369↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26228)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26243): Process ended prematurely: osmo-stp_10.42.42.5(pid=26243) [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26243)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26257): Process ended prematurely: osmo-stp_10.42.42.5(pid=26257) [trial-2369↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26257)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26265): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26265) [trial-2369↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26265)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=26275): Process ended prematurely: osmo-stp_10.42.42.5(pid=26275) [trial-2369↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26275)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26284): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26284) [trial-2369↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26284)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=26295): Process ended prematurely: osmo-stp_10.42.42.5(pid=26295) [trial-2369↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26295)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26309): Process ended prematurely: osmo-stp_10.42.42.5(pid=26309) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26309)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26320): Process ended prematurely: osmo-stp_10.42.42.5(pid=26320) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26320)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26334): Process ended prematurely: osmo-stp_10.42.42.5(pid=26334) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26334)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26345): Process ended prematurely: osmo-stp_10.42.42.5(pid=26345) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26345)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26359): Process ended prematurely: osmo-stp_10.42.42.5(pid=26359) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26370): Process ended prematurely: osmo-stp_10.42.42.5(pid=26370) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26370)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26384): Process ended prematurely: osmo-stp_10.42.42.5(pid=26384) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26384)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26395): Process ended prematurely: osmo-stp_10.42.42.5(pid=26395) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26395)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26409): Process ended prematurely: osmo-stp_10.42.42.5(pid=26409) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26409)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26421): Process ended prematurely: osmo-stp_10.42.42.5(pid=26421) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26421)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26435): Process ended prematurely: osmo-stp_10.42.42.5(pid=26435) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26435)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26446): Process ended prematurely: osmo-stp_10.42.42.5(pid=26446) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26446)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26460): Process ended prematurely: osmo-stp_10.42.42.5(pid=26460) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26460)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26471): Process ended prematurely: osmo-stp_10.42.42.5(pid=26471) [trial-2369↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26471)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26485): Process ended prematurely: osmo-stp_10.42.42.5(pid=26485) [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26496): Process ended prematurely: osmo-stp_10.42.42.5(pid=26496) [trial-2369↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26496)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26517): Process ended prematurely: osmo-stp_10.42.42.5(pid=26517) [trial-2369↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26529): Process ended prematurely: osmo-stp_10.42.42.5(pid=26529) [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26529)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26548): Process ended prematurely: osmo-stp_10.42.42.5(pid=26548) [trial-2369↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26548)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26558): Process ended prematurely: osmo-stp_10.42.42.5(pid=26558) [trial-2369↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26558)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26568): Process ended prematurely: osmo-stp_10.42.42.5(pid=26568) [trial-2369↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26568)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=26585): Process ended prematurely: osmo-stp_10.42.42.5(pid=26585) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26585)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26597): Process ended prematurely: osmo-stp_10.42.42.5(pid=26597) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26597)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26615): Process ended prematurely: osmo-stp_10.42.42.5(pid=26615) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26615)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26625): Process ended prematurely: osmo-stp_10.42.42.5(pid=26625) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26625)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26635): Process ended prematurely: osmo-stp_10.42.42.5(pid=26635) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26635)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=26653): Process ended prematurely: osmo-stp_10.42.42.5(pid=26653) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26653)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26665): Process ended prematurely: osmo-stp_10.42.42.5(pid=26665) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26665)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26684): Process ended prematurely: osmo-stp_10.42.42.5(pid=26684) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26694): Process ended prematurely: osmo-stp_10.42.42.5(pid=26694) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26694)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26705): Process ended prematurely: osmo-stp_10.42.42.5(pid=26705) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26705)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26722): Process ended prematurely: osmo-stp_10.42.42.5(pid=26722) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26722)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26734): Process ended prematurely: osmo-stp_10.42.42.5(pid=26734) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26752): Process ended prematurely: osmo-stp_10.42.42.5(pid=26752) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26752)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26762): Process ended prematurely: osmo-stp_10.42.42.5(pid=26762) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26762)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26772): Process ended prematurely: osmo-stp_10.42.42.5(pid=26772) [trial-2369↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26772)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26787): Process ended prematurely: osmo-stp_10.42.42.5(pid=26787) [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26787)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26800): Process ended prematurely: osmo-stp_10.42.42.5(pid=26800) [trial-2369↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26800)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26808) [trial-2369↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26808)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26818): Process ended prematurely: osmo-stp_10.42.42.5(pid=26818) [trial-2369↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26818)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26827): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26827) [trial-2369↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26827)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26840): Process ended prematurely: osmo-stp_10.42.42.5(pid=26840) [trial-2369↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26840)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26854): Process ended prematurely: osmo-stp_10.42.42.5(pid=26854) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26854)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26865): Process ended prematurely: osmo-stp_10.42.42.5(pid=26865) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26865)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26879): Process ended prematurely: osmo-stp_10.42.42.5(pid=26879) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26879)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26890): Process ended prematurely: osmo-stp_10.42.42.5(pid=26890) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26890)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26904): Process ended prematurely: osmo-stp_10.42.42.5(pid=26904) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26915): Process ended prematurely: osmo-stp_10.42.42.5(pid=26915) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26915)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26929): Process ended prematurely: osmo-stp_10.42.42.5(pid=26929) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26929)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26940): Process ended prematurely: osmo-stp_10.42.42.5(pid=26940) [trial-2369↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26940)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26954): Process ended prematurely: osmo-stp_10.42.42.5(pid=26954) [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26954)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26965): Process ended prematurely: osmo-stp_10.42.42.5(pid=26965) [trial-2369↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26965)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26980): Process ended prematurely: osmo-stp_10.42.42.5(pid=26980) [trial-2369↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26980)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26991): Process ended prematurely: osmo-stp_10.42.42.5(pid=26991) [trial-2369↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26991)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=27010): Process ended prematurely: osmo-stp_10.42.42.5(pid=27010) [trial-2369↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27010)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=27023): Process ended prematurely: osmo-stp_10.42.42.5(pid=27023) [trial-2369↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27023)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=27041): Process ended prematurely: osmo-stp_10.42.42.5(pid=27041) [trial-2369↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27041)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27052): Process ended prematurely: osmo-stp_10.42.42.5(pid=27052) [trial-2369↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27052)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27062): Process ended prematurely: osmo-stp_10.42.42.5(pid=27062) [trial-2369↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27062)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=27350): Process ended prematurely: osmo-stp_10.42.42.5(pid=27350) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27350)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=27362): Process ended prematurely: osmo-stp_10.42.42.5(pid=27362) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27362)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27380): Process ended prematurely: osmo-stp_10.42.42.5(pid=27380) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27390): Process ended prematurely: osmo-stp_10.42.42.5(pid=27390) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27390)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27400): Process ended prematurely: osmo-stp_10.42.42.5(pid=27400) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27400)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=27419): Process ended prematurely: osmo-stp_10.42.42.5(pid=27419) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27419)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27433): Process ended prematurely: osmo-stp_10.42.42.5(pid=27433) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27433)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=27451): Process ended prematurely: osmo-stp_10.42.42.5(pid=27451) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27451)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27471): Process ended prematurely: osmo-stp_10.42.42.5(pid=27471) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27471)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27761): Process ended prematurely: osmo-stp_10.42.42.5(pid=27761) [trial-2369↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27761)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=28019): Process ended prematurely: osmo-stp_10.42.42.5(pid=28019) [trial-2369↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28019)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28036): Process ended prematurely: osmo-stp_10.42.42.5(pid=28036) [trial-2369↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28036)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=28046): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28046) [trial-2369↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28046)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28056): Process ended prematurely: osmo-stp_10.42.42.5(pid=28056) [trial-2369↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28056)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28071): Process ended prematurely: osmo-stp_10.42.42.5(pid=28071) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28071)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28082): Process ended prematurely: osmo-stp_10.42.42.5(pid=28082) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28082)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28096): Process ended prematurely: osmo-stp_10.42.42.5(pid=28096) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28096)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28107): Process ended prematurely: osmo-stp_10.42.42.5(pid=28107) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28121): Process ended prematurely: osmo-stp_10.42.42.5(pid=28121) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28121)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28132): Process ended prematurely: osmo-stp_10.42.42.5(pid=28132) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28132)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28148): Process ended prematurely: osmo-stp_10.42.42.5(pid=28148) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28148)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28159): Process ended prematurely: osmo-stp_10.42.42.5(pid=28159) [trial-2369↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28159)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28173): Process ended prematurely: osmo-stp_10.42.42.5(pid=28173) [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28173)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28184): Process ended prematurely: osmo-stp_10.42.42.5(pid=28184) [trial-2369↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28184)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28198): Process ended prematurely: osmo-stp_10.42.42.5(pid=28198) [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28198)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28209): Process ended prematurely: osmo-stp_10.42.42.5(pid=28209) [trial-2369↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28209)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28223): Process ended prematurely: osmo-stp_10.42.42.5(pid=28223) [trial-2369↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28223)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28234): Process ended prematurely: osmo-stp_10.42.42.5(pid=28234) [trial-2369↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28234)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=28252): Process ended prematurely: osmo-stp_10.42.42.5(pid=28252) [trial-2369↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28252)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28264): Process ended prematurely: osmo-stp_10.42.42.5(pid=28264) [trial-2369↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28264)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=28282): Process ended prematurely: osmo-stp_10.42.42.5(pid=28282) [trial-2369↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28292): Process ended prematurely: osmo-stp_10.42.42.5(pid=28292) [trial-2369↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28292)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28303): Process ended prematurely: osmo-stp_10.42.42.5(pid=28303) [trial-2369↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28303)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=28322): Process ended prematurely: osmo-stp_10.42.42.5(pid=28322) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28322)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28334): Process ended prematurely: osmo-stp_10.42.42.5(pid=28334) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28334)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=28357): Process ended prematurely: osmo-stp_10.42.42.5(pid=28357) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28357)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28367): Process ended prematurely: osmo-stp_10.42.42.5(pid=28367) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28367)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28377): Process ended prematurely: osmo-stp_10.42.42.5(pid=28377) [trial-2369↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28377)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28394): Process ended prematurely: osmo-stp_10.42.42.5(pid=28394) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28394)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28406): Process ended prematurely: osmo-stp_10.42.42.5(pid=28406) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28406)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28424): Process ended prematurely: osmo-stp_10.42.42.5(pid=28424) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28424)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28434): Process ended prematurely: osmo-stp_10.42.42.5(pid=28434) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28444): Process ended prematurely: osmo-stp_10.42.42.5(pid=28444) [trial-2369↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=28461): Process ended prematurely: osmo-stp_10.42.42.5(pid=28461) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28461)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28473): Process ended prematurely: osmo-stp_10.42.42.5(pid=28473) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28473)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=28491): Process ended prematurely: osmo-stp_10.42.42.5(pid=28491) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28491)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28502): Process ended prematurely: osmo-stp_10.42.42.5(pid=28502) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28502)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28512): Process ended prematurely: osmo-stp_10.42.42.5(pid=28512) [trial-2369↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28512)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28526): Process ended prematurely: osmo-stp_10.42.42.5(pid=28526) [trial-2369↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28526)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=28536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28536) [trial-2369↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28536)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=28538): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28538) [trial-2369↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28538)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=28540): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28540) [trial-2369↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28540)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28542): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28542) [trial-2369↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28542)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=28551): Process ended prematurely: osmo-hlr_10.42.42.2(pid=28551) [trial-2369↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28551)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=28562): Process ended prematurely: osmo-hlr_10.42.42.2(pid=28562) [trial-2369↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28562)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28574): Process ended prematurely: osmo-stp_10.42.42.5(pid=28574) [trial-2369↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28574)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28585): Process ended prematurely: osmo-stp_10.42.42.5(pid=28585) [trial-2369↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28585)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28599): Process ended prematurely: osmo-stp_10.42.42.5(pid=28599) [trial-2369↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28599)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28610): Process ended prematurely: osmo-stp_10.42.42.5(pid=28610) [trial-2369↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28610)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28621): Process ended prematurely: osmo-stp_10.42.42.5(pid=28621) [trial-2369↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28621)] FAIL: register_a5_3_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28632): Process ended prematurely: osmo-stp_10.42.42.5(pid=28632) [trial-2369↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28632)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=28652): Process ended prematurely: srsepc(pid=28652) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28652)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=28669): Process ended prematurely: srsepc(pid=28669) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28669)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=28685): Process ended prematurely: srsepc(pid=28685) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28685)] FAIL: iperf3_ul.py (19.0 sec) Error: srsepc(pid=28704): Process ended prematurely: srsepc(pid=28704) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28704)] FAIL: ping.py (18.5 sec) Error: srsepc(pid=28720): Process ended prematurely: srsepc(pid=28720) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28720)] FAIL: rrc_idle_mo_ping.py (18.4 sec) Error: srsepc(pid=28736): Process ended prematurely: srsepc(pid=28736) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28736)] FAIL: rrc_idle_mt_ping.py (18.2 sec) Error: srsepc(pid=28754): Process ended prematurely: srsepc(pid=28754) [trial-2369↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=28754)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28767): Process ended prematurely: osmo-stp_10.42.42.5(pid=28767) [trial-2369↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28767)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28782): Process ended prematurely: osmo-stp_10.42.42.5(pid=28782) [trial-2369↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28782)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28796): Process ended prematurely: osmo-stp_10.42.42.5(pid=28796) [trial-2369↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28796)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28810): Process ended prematurely: osmo-stp_10.42.42.5(pid=28810) [trial-2369↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28810)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28824): Process ended prematurely: osmo-stp_10.42.42.5(pid=28824) [trial-2369↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2369↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28852): Process ended prematurely: osmo-stp_10.42.42.5(pid=28852) [trial-2369↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28852)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28866): Process ended prematurely: osmo-stp_10.42.42.5(pid=28866) [trial-2369↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28866)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2369↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28895): Process ended prematurely: osmo-stp_10.42.42.5(pid=28895) [trial-2369↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28895)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29181): Process ended prematurely: osmo-stp_10.42.42.5(pid=29181) [trial-2369↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29181)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=29195): Process ended prematurely: osmo-stp_10.42.42.5(pid=29195) [trial-2369↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29195)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29210): Process ended prematurely: osmo-stp_10.42.42.5(pid=29210) [trial-2369↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29224): Process ended prematurely: osmo-stp_10.42.42.5(pid=29224) [trial-2369↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29224)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29238): Process ended prematurely: osmo-stp_10.42.42.5(pid=29238) [trial-2369↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29238)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29252): Process ended prematurely: osmo-stp_10.42.42.5(pid=29252) [trial-2369↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29252)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29273): Process ended prematurely: osmo-stp_10.42.42.5(pid=29273) [trial-2369↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29273)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29287): Process ended prematurely: osmo-stp_10.42.42.5(pid=29287) [trial-2369↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29287)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29302): Process ended prematurely: osmo-stp_10.42.42.5(pid=29302) [trial-2369↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29302)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29319): Process ended prematurely: osmo-stp_10.42.42.5(pid=29319) [trial-2369↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29319)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29333): Process ended prematurely: osmo-stp_10.42.42.5(pid=29333) [trial-2369↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29333)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29347): Process ended prematurely: osmo-stp_10.42.42.5(pid=29347) [trial-2369↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29347)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29361): Process ended prematurely: osmo-stp_10.42.42.5(pid=29361) [trial-2369↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29361)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29375): Process ended prematurely: osmo-stp_10.42.42.5(pid=29375) [trial-2369↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29375)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29389): Process ended prematurely: osmo-stp_10.42.42.5(pid=29389) [trial-2369↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29389)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29403): Process ended prematurely: osmo-stp_10.42.42.5(pid=29403) [trial-2369↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=29417): Process ended prematurely: osmo-stp_10.42.42.5(pid=29417) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29417)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29431): Process ended prematurely: osmo-stp_10.42.42.5(pid=29431) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29445): Process ended prematurely: osmo-stp_10.42.42.5(pid=29445) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29445)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29459): Process ended prematurely: osmo-stp_10.42.42.5(pid=29459) [trial-2369↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29459)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29473): Process ended prematurely: osmo-stp_10.42.42.5(pid=29473) [trial-2369↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29473)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29487): Process ended prematurely: osmo-stp_10.42.42.5(pid=29487) [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29487)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29501): Process ended prematurely: osmo-stp_10.42.42.5(pid=29501) [trial-2369↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29501)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29515): Process ended prematurely: osmo-stp_10.42.42.5(pid=29515) [trial-2369↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29515)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29529): Process ended prematurely: osmo-stp_10.42.42.5(pid=29529) [trial-2369↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29529)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29543): Process ended prematurely: osmo-stp_10.42.42.5(pid=29543) [trial-2369↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29543)] + rm -rf trial-2369/inst + cd trial-2369 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 03:34:28 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369-run.tgz run.2022-12-10_03-34-39 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2369-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17657.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2952.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29267.tgz osmo-nitb.build-12970.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30044.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE